-- Logs begin at Wed 2022-03-02 02:10:26 UTC, end at Wed 2022-03-02 03:54:16 UTC. -- Mar 02 03:27:23.058632 dv-cinder-831090-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 02 03:27:23.068072 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Mar 2 03:27:23 2022] *** Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: nodename: dv-cinder-831090-3-iscsi Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: machine: x86_64 Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: clock source: unix Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: pcre jit disabled Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: detected number of CPU cores: 4 Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: current working directory: / Mar 02 03:27:23.070070 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: detected binary path: /usr/bin/uwsgi-core Mar 02 03:27:23.070745 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: your processes number limit is 47680 Mar 02 03:27:23.070745 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: your memory page size is 4096 bytes Mar 02 03:27:23.070745 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: detected max file descriptor number: 2048 Mar 02 03:27:23.070745 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: lock engine: pthread robust mutexes Mar 02 03:27:23.070745 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: thunder lock: enabled Mar 02 03:27:23.070745 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 02 03:27:23.070745 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 02 03:27:23.115117 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: Python main interpreter initialized at 0x55ead82879c0 Mar 02 03:27:23.115117 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: python threads support enabled Mar 02 03:27:23.115117 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: your server socket listen backlog is limited to 100 connections Mar 02 03:27:23.115117 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: your mercy for graceful operations on workers is 90 seconds Mar 02 03:27:23.115412 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: mapped 403077 bytes (393 KB) for 2 cores Mar 02 03:27:23.115477 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: *** Operational MODE: preforking *** Mar 02 03:27:23.115736 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: *** uWSGI is running in multiple interpreter mode *** Mar 02 03:27:23.115736 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: spawned uWSGI master process (pid: 102546) Mar 02 03:27:23.115922 dv-cinder-831090-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 02 03:27:23.117217 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: spawned uWSGI worker 1 (pid: 102547, cores: 1) Mar 02 03:27:23.117217 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: spawned uWSGI worker 2 (pid: 102548, cores: 1) Mar 02 03:27:23.117217 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 02 03:27:24.972341 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:27:24.972341 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: from cryptography.utils import int_from_bytes Mar 02 03:27:24.973010 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:27:24.973010 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: from cryptography.utils import int_from_bytes Mar 02 03:27:24.997416 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:27:24.997416 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: from cryptography.utils import int_from_bytes Mar 02 03:27:24.997958 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:27:24.997958 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: from cryptography.utils import int_from_bytes Mar 02 03:27:27.549619 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 02 03:27:27.550177 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 02 03:27:27.550395 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 02 03:27:27.550764 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 02 03:27:27.551026 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 02 03:27:27.551447 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.551779 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.552106 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.552432 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.552772 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.553088 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.553414 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.553737 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.554074 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.554342 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.554662 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.554996 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831090-3-iscsi {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.555352 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.555667 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.555985 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.556312 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.556625 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.556955 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.557270 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.557780 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.558949 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.558949 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.558949 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.559242 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.559518 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831090-3-iscsi {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.562497 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.563107 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.563107 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.563435 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.563752 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.565918 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.565918 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.565918 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.565918 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.565918 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.565918 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.566379 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.566379 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.566827 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.566940 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.567228 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.567545 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.567858 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.568115 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.568430 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.568760 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.569089 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.569418 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.569676 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.569932 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.570343 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.570720 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.571040 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.571376 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.571689 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.572004 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.572317 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.572630 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.572944 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.573262 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.573591 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.573909 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.574240 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.574556 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.574885 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.575321 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.575582 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.575895 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.576246 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.576576 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.576894 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.577222 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.577549 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.578382 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.578700 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.579014 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.579444 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.579789 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.580103 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.580362 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.580671 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.580988 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.581316 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.581628 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.581941 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.582255 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.582564 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.582875 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.583213 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.583532 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.583846 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.584159 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.584470 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.584782 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.585095 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.585407 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.585734 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.586062 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.586375 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.587351 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.587351 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.587351 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.587649 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.587964 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.588276 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.588601 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.588915 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.589226 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.589551 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.589865 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.590177 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.590504 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.590915 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.591261 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.591589 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.591903 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.592218 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.592540 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.592850 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.593155 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.593546 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.594364 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.594678 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.594986 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.595339 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.595865 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.595980 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.596288 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.596855 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.597184 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.597530 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.597870 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.598221 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.598543 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.599843 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.599843 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.599843 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.599843 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.600174 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.600507 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.600829 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.601148 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.601473 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.601797 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.602393 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.602498 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.602623 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 02 03:27:27.603037 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.603162 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 02 03:27:27.603252 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.604085 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.604192 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 02 03:27:27.604273 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.604359 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 02 03:27:27.604359 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 02 03:27:27.604508 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.604508 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.604722 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.604802 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.604879 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.604966 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.605046 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.605303 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.605398 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.605647 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.605743 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.605962 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.606049 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.606286 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.606372 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.606614 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.606710 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.606933 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.607021 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.607219 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.607320 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.607538 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.607627 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.607865 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831090-3-iscsi {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.607952 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.608193 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.608279 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.608653 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.608760 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.608896 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.608989 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.609230 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.609325 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.609553 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.609799 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.610064 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.610155 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.610390 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.610486 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.610711 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.610965 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.611088 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.611309 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.611407 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.611623 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.611718 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.611938 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.612031 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.612276 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.612371 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.612597 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.612711 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.613056 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.613375 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.613690 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.614004 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.614317 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.614403 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.614637 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.614763 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.614951 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.615085 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.615307 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.615405 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.615642 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.615900 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.615986 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.616283 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.616582 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831090-3-iscsi {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.616678 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.616900 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.616985 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.617218 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.617316 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.617537 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.617624 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.617849 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.618058 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.618148 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.618382 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.618467 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.618700 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.618801 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.619031 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.619160 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.619384 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.619477 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.619701 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.619801 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.620029 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.620163 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.620345 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.620433 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.620658 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.620761 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.620982 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.621070 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.621299 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.621414 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.621616 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.621735 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.621933 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.622052 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.622252 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.622379 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.622585 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.622674 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.622903 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.623099 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.623247 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.623335 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.623589 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.623685 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.623929 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.624016 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.624243 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.624329 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.624573 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.624682 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.624980 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.625173 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.625261 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.625503 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.625658 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.625816 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.625991 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.626137 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.626305 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.626449 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.626618 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.626763 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.626929 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.627095 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.627285 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.627413 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.627597 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.627723 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.627916 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.628035 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.628227 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.629153 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.629248 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.629329 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.629407 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.629492 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.629586 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.629668 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.629747 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.629849 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.629942 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.630022 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.630109 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.630233 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.630454 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.630542 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.630709 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.630794 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.631022 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.631192 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.631390 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.631485 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.631718 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.631805 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.632035 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.632123 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.632403 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.632580 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.632908 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.633235 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.633555 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.633876 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.633974 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.634196 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.634282 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.634515 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.634952 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.635391 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.635484 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.635564 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.635642 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.635731 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.635812 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.635900 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.635980 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.636444 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.636549 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.636642 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.636723 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.636802 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.636888 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.637086 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.637173 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.637400 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.637489 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.637713 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.637801 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.638026 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.638121 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.638332 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.638421 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.638646 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.638734 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.638963 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.639082 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.640259 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.640834 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.640903 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.640967 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.641031 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.641109 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.641202 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.641289 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.641289 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.641433 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.641865 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.641961 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.642043 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.642130 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.642212 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.642291 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.642369 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.642527 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.642666 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.642760 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.642984 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.643106 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.643332 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.643458 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.643644 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.643736 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.643967 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.644058 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.644304 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.644402 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.644642 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.644729 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.644959 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.645106 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.645275 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.645363 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.645588 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.645677 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.645903 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.645988 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.646211 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.646305 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.646522 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.646608 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.646830 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.646914 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.647164 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.647255 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.647480 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.647578 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.647798 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.647884 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.648107 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.648193 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.648418 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.648505 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.648727 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.648821 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.649035 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.649120 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.649351 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.649468 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.649662 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.649804 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.649968 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.650117 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.650281 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.650475 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.650625 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.650803 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.651024 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.651213 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.651352 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.651453 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.651534 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.651721 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.651808 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.652034 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.652126 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.652347 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.652441 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:27:27.652683 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.652770 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.653002 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.653088 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.653316 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.653442 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.653627 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.653713 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.653981 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.654331 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.654648 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.654960 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.655310 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.655399 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.655642 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.655777 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.656006 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.657326 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.657442 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.657528 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.657613 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.657926 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.657926 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.658806 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.658886 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.658975 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659078 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659161 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659253 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659334 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659459 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659553 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659641 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659726 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659814 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.659893 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.660034 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.660127 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.660365 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.660452 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.660692 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.660779 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.661008 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.661101 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.661331 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.661425 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.661641 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.661734 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.661961 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.662046 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.662285 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.662381 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.662630 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.662878 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.663131 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.663289 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.663437 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.663609 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.663762 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.663902 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.664072 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.664181 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.664391 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.664509 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.664717 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.664926 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.665094 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.665255 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.665419 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.665568 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.665746 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.665834 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.666065 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.666160 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.666396 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.666576 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.666724 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.667079 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.667217 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.667446 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.667582 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.667722 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.667854 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.667987 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.668121 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.668263 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.668395 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.668536 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.668667 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.668794 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.668933 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.669064 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.669195 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.669351 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.669481 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.669612 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.669740 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.669870 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.670031 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.670291 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.670426 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.670559 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.670693 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.670827 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.670973 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.671213 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.671343 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.671490 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.671628 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.671756 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.671894 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.672214 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.672345 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.672561 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.672697 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.672875 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.673029 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.673197 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.673334 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.673541 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.673665 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.673888 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.673988 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.674201 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.674288 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.674514 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.674600 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.674864 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.674977 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.675183 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.675286 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.675500 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.675596 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.675812 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.675905 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.676130 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.676220 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.676445 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.676535 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.676755 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.676866 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.677063 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.677151 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.677378 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.677466 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.677692 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.677853 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.678101 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.678190 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.678413 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.678730 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.679042 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.679386 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.679709 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.679818 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.680021 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.680126 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.680332 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.680419 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.680652 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.680895 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.681899 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.681899 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682075 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682156 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682234 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682234 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682394 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682473 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682550 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682627 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682705 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.682925 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.683026 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.683268 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.683358 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.683607 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.683695 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.683928 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.684027 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.684244 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.684330 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.684556 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.684641 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.684877 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.684973 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.685191 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.685322 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.685501 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.685586 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.685814 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.685909 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.686126 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.686241 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.686440 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.686557 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.686761 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.686857 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.687128 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.687264 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.687916 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.688021 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.688265 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.688362 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.688595 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.688688 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.688911 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.688997 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.689226 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.689320 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.689539 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.689624 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.689848 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.689942 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.690162 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.690247 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.690475 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.690563 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.690789 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.690885 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.691128 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.691219 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.691452 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.691543 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.691788 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.691889 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.692109 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.692195 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.692422 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.692516 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.692737 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.692840 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.693046 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.693130 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.693359 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.693626 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.693720 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.693944 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.694032 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.694323 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.694472 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.694624 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.694785 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.694931 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.695177 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.695300 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.695429 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.695549 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.695646 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.695871 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.695957 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.696180 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.696265 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.696500 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.696600 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.696824 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.696908 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.697147 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.697256 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.697471 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.697644 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.697880 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.697970 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.698245 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.698578 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.698901 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.699254 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.699436 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.699581 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.699782 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.699898 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.700117 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.700235 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.700447 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701474 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701550 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701617 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701694 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701763 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701834 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701900 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.701971 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.702042 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.702203 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.702363 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.702451 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.702703 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.703290 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.703778 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.703892 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.703975 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.704120 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.704208 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.704436 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.704536 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.704761 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.704874 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.705080 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.705166 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.705400 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.705485 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.705715 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.705808 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.706043 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.706126 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.706360 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.706448 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.706679 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.706810 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.706986 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.707318 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.707504 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.707669 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.707805 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.707892 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.707959 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.708111 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.708354 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.708443 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.708680 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.708811 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.708997 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.709167 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.709337 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.709503 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.709612 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.709717 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.709912 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.710040 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.710241 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.710375 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.710566 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.710725 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.710882 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.711015 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.711276 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.711413 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.711604 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.711748 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.711921 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.712079 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.712244 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.712380 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.712559 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.712692 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.712868 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.713017 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.713183 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.713330 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.713514 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.713649 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.713825 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.713975 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.714133 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.714275 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.714443 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.714580 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.714749 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.714897 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.715100 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.715262 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.715426 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.715563 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.715778 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.715925 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.716049 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.716174 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.716356 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.716495 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.716673 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.716874 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.717011 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.717193 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.717342 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.717511 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.717641 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.717840 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.717918 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.718173 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.718258 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.719493 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.719622 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.719693 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.719759 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.719877 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.720006 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.720198 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.720325 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.720534 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.720625 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.720870 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.720966 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.721191 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.721279 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.721770 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.721859 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.722084 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.722177 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.722415 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.722501 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.722847 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.722944 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.723201 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.723537 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.723962 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.724296 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.724491 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.724615 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.724944 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.725104 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.725446 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.725581 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.725669 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.725892 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.726146 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.726244 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.726600 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.726706 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.726825 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.726993 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.727180 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.727363 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.727498 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.727718 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.727804 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.728065 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.728164 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.728425 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.728512 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.728739 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.728825 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.729052 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.729152 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.729368 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.729462 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.729680 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.729772 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.730001 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.730088 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.730317 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.730411 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.730631 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.730717 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.730960 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.731071 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.731301 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.731390 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.731634 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.731720 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.731953 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.732039 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.732268 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.732360 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.732586 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.732673 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.732897 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.732989 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.733249 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.733336 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.733559 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.733645 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.733869 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.733962 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.734531 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.734635 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.734635 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.734756 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.734867 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.734968 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.735200 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.735303 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.735514 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.735608 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.735866 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.735965 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.736177 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.736263 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.736508 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.736594 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.736820 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.736916 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.737132 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.737218 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.737450 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.737535 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.737763 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.737858 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.738075 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.738169 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.738385 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.738470 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.738696 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.738783 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.739005 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.739117 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.739341 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.739428 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.739652 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.739739 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.739958 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.740043 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.740275 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.740357 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.740588 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.740664 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.740913 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.741039 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.741220 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.741388 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.741537 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.741680 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.741828 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.741943 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.742111 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.742209 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.742430 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.742524 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.742743 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.742830 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.743095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.743199 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.743384 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.743478 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.743700 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.743787 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.744017 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.744113 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.744442 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.744540 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.744861 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.744949 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.745184 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.745305 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.745508 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.745674 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.745829 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.746029 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.746152 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.746372 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.746467 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.746783 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.747072 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.747162 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748206 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748304 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748396 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748484 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748564 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748642 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748732 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.748929 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.749024 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.749250 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.749367 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.749572 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.749956 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.750375 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.750514 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.750599 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.750675 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.750754 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.750915 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.751076 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.751258 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.751577 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.751899 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.752236 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.752433 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.752589 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.752738 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.752883 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.753037 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.753201 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.753364 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.753520 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.753843 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.754163 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.754495 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.754671 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.754838 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.754994 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.755219 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.755487 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.755809 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.755949 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.756137 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.756294 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.756449 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.756601 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.756763 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.756938 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.757088 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.757269 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.757405 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.757598 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.757735 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.757936 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.758074 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.758235 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.758369 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.758560 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.758697 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.758905 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.759045 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.759258 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.759412 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.759579 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.759716 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.759905 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.760044 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.760219 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.760352 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.760542 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.760701 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.760865 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.761003 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.761252 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.761388 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.761573 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.761719 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.761908 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.762046 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.762245 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.762385 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.762581 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.762730 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.762865 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.762999 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.763722 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.763939 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764132 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764293 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764414 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764521 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764634 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764740 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764852 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.764969 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.765075 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.765180 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.765821 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.765997 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.766644 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.766644 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.766864 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.766979 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.767104 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.767229 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.767357 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.767464 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.767568 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.767699 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.767811 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.768042 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.768300 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.768426 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.768590 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.768703 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.768928 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.769043 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.769265 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.769387 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.769591 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.769681 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.769909 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.770006 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.770231 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.770317 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.770548 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.770634 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.770864 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.770960 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.771254 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772190 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772288 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772371 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772457 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772546 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772615 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772615 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772746 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772824 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.772908 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.773036 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.773166 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.773355 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.773511 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.773666 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.773841 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.773999 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.774161 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.774315 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.774488 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.774628 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.774810 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.774941 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.775162 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.775287 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.775483 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.775582 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.775899 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.775987 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.776209 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.776295 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.776522 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.776788 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.776892 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.777137 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.777386 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.777473 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.777753 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.777848 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.778071 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.778158 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.778386 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.778537 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.778703 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.779094 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.779194 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.779435 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.779619 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.779747 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.780061 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.780156 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.780388 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.780653 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.780743 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.781958 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.782101 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.782194 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.782363 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.782448 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.782722 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.782904 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.783101 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.783473 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.783634 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.783981 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.784075 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.784316 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.784595 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.784683 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.784991 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.785148 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.785309 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.785628 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.785723 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.785943 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.786229 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.786316 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.786584 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.786796 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.786905 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.787250 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.787368 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.787573 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.787894 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.787992 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.788213 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.788533 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.788672 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.788853 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.789169 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.789491 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.789793 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.789902 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.790121 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.790283 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.790430 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.790578 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.790768 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.790904 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.791120 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.791276 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.791447 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.791627 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.791759 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.791978 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.792068 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.792324 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.792421 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.792668 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.792807 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.793100 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.793199 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.793320 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.793418 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.793667 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.793762 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.794015 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.794102 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.794338 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.794427 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.794652 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.794747 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.794989 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.795097 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.795416 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.795749 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.796761 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.797420 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.797523 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.797605 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.797696 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.797786 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.797866 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.797946 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798024 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798024 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798185 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798273 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798352 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798561 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798657 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.798910 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.799004 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.799274 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.799361 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.799605 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.799759 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.799918 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.800016 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.800231 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.800544 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.800861 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.801197 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.801355 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.801518 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.801686 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.801842 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.802018 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.802190 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.802420 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.802730 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.803041 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.803228 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.803424 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.803589 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.803752 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.803915 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.804076 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.804282 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.804590 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.804907 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.805058 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.805219 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.805368 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.805509 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.805640 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.806046 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.806199 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.806331 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.806464 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.806594 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.806742 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.806878 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.807033 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.807222 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.807349 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.807495 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.807638 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.807780 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.807915 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.808049 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.808192 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.808322 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.808540 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.808682 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.808866 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.809005 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.809183 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.809324 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.809477 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.809611 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.809830 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.809964 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.810132 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.810288 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.810449 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.810594 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.810768 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.810897 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.811106 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.811265 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.811447 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.811590 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.811763 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.811897 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.812082 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.812266 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.812568 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.812868 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.813015 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.813331 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.813474 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.813679 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.813776 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.813858 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.814179 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.814477 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.814639 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.814788 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.814936 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.815138 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.815291 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.815475 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.815579 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.815766 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.815862 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.816082 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.816170 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.816417 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.816518 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.816737 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.816833 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.817054 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.817142 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.817368 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.817464 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.817684 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.817778 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.818020 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.818157 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.818339 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.818481 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.818677 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.818806 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.819008 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.819261 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.819349 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.819599 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.819687 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.819936 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.820013 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.820274 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.820727 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.820963 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.821049 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.821250 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.821363 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.821609 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.821722 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.821929 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.822251 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.822349 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.822562 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.822700 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.822952 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.823144 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 02 03:27:27.823310 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.823657 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.823992 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.824323 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.824652 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.826276 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.826619 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.827277 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.828710 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.829048 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.830163 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.830506 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.830845 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.831467 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.831818 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.832155 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.832489 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.832820 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.833155 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.833487 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.833815 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.834453 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.834791 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.835354 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.835965 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.836470 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.836821 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.837182 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.837520 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.837854 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.838185 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.838517 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.838896 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.839249 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.839575 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.839905 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.840239 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.840610 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.840895 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.841212 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.842375 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.842375 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.842375 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.842947 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.844206 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.844782 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.845425 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.845903 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.846248 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.846837 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.847195 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.847430 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_db.sqlalchemy.engines [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:27.847525 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.848104 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.848438 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.848791 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.849137 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.849624 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.850255 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.850849 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.851504 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.851848 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.852175 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.852637 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.852985 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.853324 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.853652 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.853985 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.854307 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.854644 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.854971 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.855552 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.855918 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.856250 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.856591 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.856930 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.857262 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.857585 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.857923 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.858249 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.858566 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.858894 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.859298 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.859691 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.859944 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.860283 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.860653 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.860920 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.865509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866095 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866637 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866637 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.866833 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.867198 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.867519 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.867835 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.868164 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.868489 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.868826 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.869149 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.869472 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.869833 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.870164 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.870718 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.871080 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.871420 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.871769 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.872113 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.872434 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.872761 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.873080 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.873418 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.873742 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.874067 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.874389 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.874796 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.875137 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.875462 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.875785 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.876111 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.876429 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.876750 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.877069 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.877389 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.877714 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.878064 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.878393 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.878721 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.879070 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.879396 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.879718 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.880039 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.880360 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.880688 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.881014 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.881356 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.881680 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.881996 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.882432 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.882758 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.883108 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.883442 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.883766 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.884101 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.884436 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.884757 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.885091 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.885416 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.885758 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.886109 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.886448 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.886788 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.887130 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.887450 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.887768 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.888091 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.888419 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.888738 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.889053 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.889368 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.889689 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.890006 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.890869 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.891211 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.891530 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.891852 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.892166 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.892482 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.892797 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.893118 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.893432 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.893745 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.894064 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.894374 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.894691 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.895002 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.895342 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.895655 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.895998 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.896346 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.896671 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.897005 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.897328 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.897662 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.897985 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.898320 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.898651 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.898978 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.899326 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.899669 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.899990 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.900311 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.900632 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.900953 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.901273 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.901595 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.901932 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.902269 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.902582 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.902924 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.903275 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.903609 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.903936 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.904255 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.904595 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.904916 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.905235 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.905560 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.905986 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.906818 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.907170 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.907501 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.907839 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.908178 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.908516 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.908857 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.909214 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.909537 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.909892 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.910227 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.910553 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.910790 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.context [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ec61a67-357a-4a65-915a-6ee9dabb36ce(cell1) {{(pid=102548) load_cells /opt/stack/nova/nova/context.py:464}} Mar 02 03:27:27.910940 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.911203 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:27:27.911456 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 02 03:27:27.914982 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_concurrency.lockutils [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:27:27.916598 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_concurrency.lockutils [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:27:27.917452 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_concurrency.lockutils [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:27:27.919395 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_concurrency.lockutils [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:27:27.931450 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_db.sqlalchemy.engines [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:27.932742 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_db.sqlalchemy.engines [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:27.936775 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_db.sqlalchemy.engines [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:28.000555 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.context [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ec61a67-357a-4a65-915a-6ee9dabb36ce(cell1) {{(pid=102547) load_cells /opt/stack/nova/nova/context.py:464}} Mar 02 03:27:28.004766 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:27:28.006349 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:27:28.007200 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:27:28.009128 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:27:28.023896 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_db.sqlalchemy.engines [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:28.026279 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_db.sqlalchemy.engines [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:28.092570 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG oslo_db.sqlalchemy.engines [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:28.188203 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_db.sqlalchemy.engines [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:27:28.435004 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: WARNING keystonemiddleware.auth_token [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:27:28.442535 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: WARNING keystonemiddleware.auth_token [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:27:28.510459 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: WARNING keystonemiddleware.auth_token [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:27:28.517638 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: WARNING keystonemiddleware.auth_token [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:27:28.783013 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: WARNING keystonemiddleware.auth_token [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:27:28.788211 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: WARNING keystonemiddleware.auth_token [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:27:28.793565 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ead82879c0 pid: 102548 (default app) Mar 02 03:27:28.795639 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:27:28.796902 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Mar 02 03:27:28.797319 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Wed Mar 2 03:27:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:27:28.857114 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: WARNING keystonemiddleware.auth_token [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:27:28.862327 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: WARNING keystonemiddleware.auth_token [None req-d7484c65-ce8e-473b-8eca-36044e12cd2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:27:28.867740 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ead82879c0 pid: 102547 (default app) Mar 02 03:28:50.415639 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:28:50.416639 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Mar 02 03:28:50.417041 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:28:50.923022 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-9a17098b-0972-42c4-87d5-40013226e0ab admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:28:50.958125 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-9a17098b-0972-42c4-87d5-40013226e0ab admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.533505 Mar 02 03:28:50.981934 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Mar 2 03:28:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:28:53.366672 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:28:53.367703 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-dc554db6-08f8-477d-ae21-c0e3ce11ca80 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Mar 02 03:28:53.368281 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:28:53.426737 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-de1dc8f7-1dd6-4f5b-8351-3eddaa3ab00c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "ram": 256, "swap": 0}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:28:53.444999 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:28:53.444999 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: warnings.warn(msg) Mar 02 03:28:53.477572 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-de1dc8f7-1dd6-4f5b-8351-3eddaa3ab00c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103820 Mar 02 03:28:53.478213 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:28:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 02 03:28:53.695381 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-af17a774-dea7-4df1-9bb0-ea9d283e4439 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:28:53.697791 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:28:53.697791 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: warnings.warn(msg) Mar 02 03:28:53.746361 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-af17a774-dea7-4df1-9bb0-ea9d283e4439 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260074 Mar 02 03:28:53.750982 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Mar 2 03:28:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:28:56.171494 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-de1dc8f7-1dd6-4f5b-8351-3eddaa3ab00c admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:28:56.172786 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-de1dc8f7-1dd6-4f5b-8351-3eddaa3ab00c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Mar 02 03:28:56.173196 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:28:56.291769 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-a3b91e6d-1d09-4a07-8166-983a6553298a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:28:56.309734 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:28:56.309734 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: warnings.warn(msg) Mar 02 03:28:56.336513 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-a3b91e6d-1d09-4a07-8166-983a6553298a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157162 Mar 02 03:28:56.337168 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:28:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:28:56.352387 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-7c2bc28d-63f1-4a18-a8b9-746eedf55f2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:28:56.353809 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:28:56.353809 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: warnings.warn(msg) Mar 02 03:28:56.386129 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-7c2bc28d-63f1-4a18-a8b9-746eedf55f2b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038427 Mar 02 03:28:56.386710 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Mar 2 03:28:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:28:58.753119 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-a3b91e6d-1d09-4a07-8166-983a6553298a admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:28:58.754132 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-a3b91e6d-1d09-4a07-8166-983a6553298a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Mar 02 03:28:58.754529 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:28:58.816963 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-8cc1a081-321d-4a27-ae3b-57ac8f1a28d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "vcpus": 1}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:28:58.840363 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-8cc1a081-321d-4a27-ae3b-57ac8f1a28d3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080067 Mar 02 03:28:58.840914 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:28:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 02 03:28:58.853141 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-6363af34-b2ea-4b07-8ed9-9ec59e0e8855 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:28:58.877439 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-6363af34-b2ea-4b07-8ed9-9ec59e0e8855 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027831 Mar 02 03:28:58.878356 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Mar 2 03:28:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:29:01.287799 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-8cc1a081-321d-4a27-ae3b-57ac8f1a28d3 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:01.288976 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-8cc1a081-321d-4a27-ae3b-57ac8f1a28d3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Mar 02 03:29:01.289385 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:01.354068 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-532b5aba-9029-471c-a74f-4575e2ec25bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:01.373546 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-532b5aba-9029-471c-a74f-4575e2ec25bd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077609 Mar 02 03:29:01.374093 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:29:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:29:01.385986 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-433be5ff-3c48-4d19-99ef-b9f0cc823e7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:01.409941 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-433be5ff-3c48-4d19-99ef-b9f0cc823e7a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027629 Mar 02 03:29:01.410703 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Mar 2 03:29:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:29:03.812535 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-532b5aba-9029-471c-a74f-4575e2ec25bd admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:03.813553 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-532b5aba-9029-471c-a74f-4575e2ec25bd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Mar 02 03:29:03.813955 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:03.873941 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-737a4598-38dc-4acb-97b2-a23086980cff admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G"}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:03.894124 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-737a4598-38dc-4acb-97b2-a23086980cff admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074491 Mar 02 03:29:03.902961 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:29:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 02 03:29:03.908249 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-7ade056a-a063-4ee5-adff-efa01ef99680 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:03.930705 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-7ade056a-a063-4ee5-adff-efa01ef99680 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027534 Mar 02 03:29:03.931732 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Mar 2 03:29:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:29:06.301340 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-737a4598-38dc-4acb-97b2-a23086980cff admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:06.302351 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-737a4598-38dc-4acb-97b2-a23086980cff admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Mar 02 03:29:06.303209 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:06.365549 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-c3141957-6023-4c07-92ec-92e47c40a03d admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:06.389297 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-c3141957-6023-4c07-92ec-92e47c40a03d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079855 Mar 02 03:29:06.390286 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Mar 2 03:29:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:29:08.742449 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-737a4598-38dc-4acb-97b2-a23086980cff admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:08.743497 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-737a4598-38dc-4acb-97b2-a23086980cff admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Mar 02 03:29:08.743903 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:29:08.803231 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-db744ef5-659f-4c5c-a6df-e7606535542f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "1", "ram": 512}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:08.820308 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-db744ef5-659f-4c5c-a6df-e7606535542f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068534 Mar 02 03:29:08.821047 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:29:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 02 03:29:08.835967 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-3d9fb9aa-b771-4e65-9bd2-c517e939ce0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:08.863378 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-3d9fb9aa-b771-4e65-9bd2-c517e939ce0a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032175 Mar 02 03:29:08.864104 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Mar 2 03:29:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:29:11.540749 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-db744ef5-659f-4c5c-a6df-e7606535542f admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:11.541806 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-db744ef5-659f-4c5c-a6df-e7606535542f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Mar 02 03:29:11.542220 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:11.603183 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-122f11ca-3884-48b6-b8ab-333f6fe9ceb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:11.620877 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-122f11ca-3884-48b6-b8ab-333f6fe9ceb4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072568 Mar 02 03:29:11.621440 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:29:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:29:11.634319 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-3f78d9f6-739e-45c9-acfa-fccc3cf07800 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:11.658540 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-3f78d9f6-739e-45c9-acfa-fccc3cf07800 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027843 Mar 02 03:29:11.659285 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Mar 2 03:29:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:29:14.072543 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-122f11ca-3884-48b6-b8ab-333f6fe9ceb4 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:14.073605 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-122f11ca-3884-48b6-b8ab-333f6fe9ceb4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Mar 02 03:29:14.074016 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:14.131261 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-6749f4fe-4a9b-4ba3-8e46-2fb3a3999953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:14.149341 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-6749f4fe-4a9b-4ba3-8e46-2fb3a3999953 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068801 Mar 02 03:29:14.149874 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:29:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:29:14.162340 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-6216b45b-1f81-4293-9871-c8565276a02c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:14.183956 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-6216b45b-1f81-4293-9871-c8565276a02c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025369 Mar 02 03:29:14.184678 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Mar 2 03:29:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:29:16.559724 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-6749f4fe-4a9b-4ba3-8e46-2fb3a3999953 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:16.561355 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-6749f4fe-4a9b-4ba3-8e46-2fb3a3999953 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Mar 02 03:29:16.562528 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:16.623108 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-92c50d71-f7ad-4f03-a31a-60be1c7d2284 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "ram": 8192, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:16.642573 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-92c50d71-f7ad-4f03-a31a-60be1c7d2284 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073979 Mar 02 03:29:16.643147 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:29:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:29:16.655036 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-964c59f5-ba1f-49d3-a6e9-389207e9ff84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:16.680061 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-964c59f5-ba1f-49d3-a6e9-389207e9ff84 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028708 Mar 02 03:29:16.681492 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Mar 2 03:29:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:29:19.093992 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-92c50d71-f7ad-4f03-a31a-60be1c7d2284 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:19.095017 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-92c50d71-f7ad-4f03-a31a-60be1c7d2284 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002405 Mar 02 03:29:19.095440 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:19.157255 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-3dab4f1c-043d-4d12-95d7-4aa1677ca591 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:19.176771 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-3dab4f1c-043d-4d12-95d7-4aa1677ca591 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074798 Mar 02 03:29:19.177591 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Mar 2 03:29:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:29:19.189880 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-f99609d9-bde6-4bcf-b5fb-9ec2f5bccf3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:19.213730 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-f99609d9-bde6-4bcf-b5fb-9ec2f5bccf3b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028207 Mar 02 03:29:19.214840 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Mar 2 03:29:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:29:42.336138 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-3dab4f1c-043d-4d12-95d7-4aa1677ca591 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:42.337136 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-3dab4f1c-043d-4d12-95d7-4aa1677ca591 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Mar 02 03:29:42.337529 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:42.392916 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-36ef9cb2-b0eb-4469-b0f6-6ba1926c65cd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:42.409411 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-36ef9cb2-b0eb-4469-b0f6-6ba1926c65cd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066272 Mar 02 03:29:42.409943 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Mar 2 03:29:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:29:43.804182 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-3dab4f1c-043d-4d12-95d7-4aa1677ca591 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:43.805183 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-3dab4f1c-043d-4d12-95d7-4aa1677ca591 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Mar 02 03:29:43.805574 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:43.998595 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-32d6f41d-4b33-4e5b-b24e-7345a3a353ea admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:44.004509 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.wsgi [None req-32d6f41d-4b33-4e5b-b24e-7345a3a353ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 02 03:29:44.005083 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-32d6f41d-4b33-4e5b-b24e-7345a3a353ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:29:44.005881 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-32d6f41d-4b33-4e5b-b24e-7345a3a353ea admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057584 Mar 02 03:29:44.006393 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Mar 2 03:29:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 02 03:29:44.016634 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-8088a3b8-105b-4d74-84c8-b21a968d6698 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:44.037013 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-8088a3b8-105b-4d74-84c8-b21a968d6698 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024984 Mar 02 03:29:44.037566 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Mar 2 03:29:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:29:44.047785 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-7cc3f5cb-0818-4227-b60b-7a6fa99171da admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:44.068896 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-7cc3f5cb-0818-4227-b60b-7a6fa99171da admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025229 Mar 02 03:29:44.069430 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Mar 2 03:29:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:29:44.080040 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-efdab37b-b793-460d-808c-2ae9af081c35 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:44.085425 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.wsgi [None req-efdab37b-b793-460d-808c-2ae9af081c35 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 02 03:29:44.085992 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-efdab37b-b793-460d-808c-2ae9af081c35 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:29:44.086779 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-efdab37b-b793-460d-808c-2ae9af081c35 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011758 Mar 02 03:29:44.087300 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Mar 2 03:29:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 02 03:29:45.376604 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-7cc3f5cb-0818-4227-b60b-7a6fa99171da admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:45.377610 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-7cc3f5cb-0818-4227-b60b-7a6fa99171da admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Mar 02 03:29:45.377999 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:45.569077 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-8053f318-eb30-4eb3-bede-e383af8af86f admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:45.574334 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.wsgi [None req-8053f318-eb30-4eb3-bede-e383af8af86f admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 02 03:29:45.574892 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-8053f318-eb30-4eb3-bede-e383af8af86f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:29:45.575718 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-8053f318-eb30-4eb3-bede-e383af8af86f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061353 Mar 02 03:29:45.576225 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Mar 2 03:29:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 02 03:29:45.585603 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-558b01cd-b81b-45cc-9131-1c9f3bc7d359 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:45.598914 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-558b01cd-b81b-45cc-9131-1c9f3bc7d359 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017071 Mar 02 03:29:45.599456 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Mar 2 03:29:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:29:45.609067 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-c94ff910-e89d-4587-a71e-3c703264f159 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:45.622786 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-c94ff910-e89d-4587-a71e-3c703264f159 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017675 Mar 02 03:29:45.623352 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Mar 2 03:29:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:29:45.633576 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-52a601ca-1c90-454c-96c6-858dc6d54e21 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:45.638867 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.wsgi [None req-52a601ca-1c90-454c-96c6-858dc6d54e21 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 02 03:29:45.639461 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-52a601ca-1c90-454c-96c6-858dc6d54e21 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:29:45.640289 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-52a601ca-1c90-454c-96c6-858dc6d54e21 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010626 Mar 02 03:29:45.640788 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Mar 2 03:29:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 02 03:29:46.921707 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-c94ff910-e89d-4587-a71e-3c703264f159 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:46.922742 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-c94ff910-e89d-4587-a71e-3c703264f159 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Mar 02 03:29:46.923199 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:47.128078 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-f7d27a06-dc88-49aa-aa0e-ae0addc625df admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:47.133516 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.wsgi [None req-f7d27a06-dc88-49aa-aa0e-ae0addc625df admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 02 03:29:47.134089 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-f7d27a06-dc88-49aa-aa0e-ae0addc625df admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:29:47.134918 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-f7d27a06-dc88-49aa-aa0e-ae0addc625df admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072220 Mar 02 03:29:47.135456 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Mar 2 03:29:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 02 03:29:47.147956 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-9bb3801f-9fc8-48e7-a00c-c283fcc12c23 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:47.165800 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-9bb3801f-9fc8-48e7-a00c-c283fcc12c23 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023479 Mar 02 03:29:47.166781 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Mar 2 03:29:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:29:47.177576 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:47.192888 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019427 Mar 02 03:29:47.198690 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Mar 2 03:29:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:29:47.208551 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-8bdd31fe-ece2-45de-828d-7857cfc11848 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:47.213744 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.wsgi [None req-8bdd31fe-ece2-45de-828d-7857cfc11848 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 02 03:29:47.214298 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-8bdd31fe-ece2-45de-828d-7857cfc11848 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:29:47.215081 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-8bdd31fe-ece2-45de-828d-7857cfc11848 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010253 Mar 02 03:29:47.215569 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Mar 2 03:29:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 02 03:29:48.491507 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:48.492527 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Mar 02 03:29:48.492925 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:48.680136 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-54e49917-9e48-4a52-bf0b-a421a7336eba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:48.699232 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-54e49917-9e48-4a52-bf0b-a421a7336eba admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069898 Mar 02 03:29:48.699763 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Mar 2 03:29:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:29:49.966555 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:49.967602 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Mar 02 03:29:49.968038 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:50.159598 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-d8340e28-a09c-4c8c-8bf0-ed9b2e16e83b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:50.177532 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-d8340e28-a09c-4c8c-8bf0-ed9b2e16e83b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070530 Mar 02 03:29:50.177996 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Mar 2 03:29:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:29:51.494603 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:51.495662 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Mar 02 03:29:51.496062 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:51.686448 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-70bd3f6c-8808-48fc-8ba6-78ed5f511639 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:51.704176 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-70bd3f6c-8808-48fc-8ba6-78ed5f511639 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068527 Mar 02 03:29:51.704637 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Mar 2 03:29:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 02 03:29:52.978645 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:52.979879 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Mar 02 03:29:52.980281 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:53.193004 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-66a441d5-3885-4ce8-bdc1-567361c17dd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:29:53.217152 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-66a441d5-3885-4ce8-bdc1-567361c17dd4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080194 Mar 02 03:29:53.217731 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Mar 2 03:29:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 02 03:29:54.496236 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:54.497234 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Mar 02 03:29:54.497621 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:29:54.686684 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-7d3ec98c-22b6-4c85-aa89-b2eff034c7ee admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:29:54.706212 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-7d3ec98c-22b6-4c85-aa89-b2eff034c7ee admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069588 Mar 02 03:29:54.706676 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Wed Mar 2 03:29:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:30:45.482252 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:30:45.483298 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-62e5b944-192a-4d22-86d2-ae57bccf58dd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Mar 02 03:30:45.483694 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Wed Mar 2 03:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:30:45.540661 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-d648811b-edd2-430f-913e-bf8308dca1bb admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:30:45.559694 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-d648811b-edd2-430f-913e-bf8308dca1bb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070350 Mar 02 03:30:45.560743 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Mar 2 03:30:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:30:45.582304 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-c3c4b4f8-2a22-4f42-992c-0be7787e6947 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:30:45.589784 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-c3c4b4f8-2a22-4f42-992c-0be7787e6947 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011070 Mar 02 03:30:45.590294 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Wed Mar 2 03:30:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:30:45.601609 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-c5a99e6a-6e75-4c08-ace8-f50658d9f417 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:30:45.609529 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-c5a99e6a-6e75-4c08-ace8-f50658d9f417 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011477 Mar 02 03:30:45.610036 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Wed Mar 2 03:30:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:30:45.620606 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-28557cb1-33c8-4563-a13b-f186545a95ea admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:30:45.628524 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-28557cb1-33c8-4563-a13b-f186545a95ea admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011346 Mar 02 03:30:45.629026 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Wed Mar 2 03:30:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:30:45.639855 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:30:45.647045 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010755 Mar 02 03:30:45.647584 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Wed Mar 2 03:30:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:32:23.357543 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-44008b09-706e-4750-a885-2f0638756959 tempest-verify_tempest_config-2136260414 tempest-verify_tempest_config-2136260414-project] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:32:23.360079 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-44008b09-706e-4750-a885-2f0638756959 tempest-verify_tempest_config-2136260414 tempest-verify_tempest_config-2136260414-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106687 Mar 02 03:32:23.360633 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1133 bytes} [Wed Mar 2 03:32:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:34:01.494281 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:01.495336 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Mar 02 03:34:01.495728 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:34:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:34:01.744576 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-789dc8a2-cdc1-4475-875a-def7d96c897c admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:01.746383 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:34:01.746383 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: warnings.warn(msg) Mar 02 03:34:01.747636 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-789dc8a2-cdc1-4475-875a-def7d96c897c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:01.748087 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-789dc8a2-cdc1-4475-875a-def7d96c897c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:01.748895 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-789dc8a2-cdc1-4475-875a-def7d96c897c admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:01.749332 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-789dc8a2-cdc1-4475-875a-def7d96c897c admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:01.783676 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-789dc8a2-cdc1-4475-875a-def7d96c897c admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149902 Mar 02 03:34:01.784237 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Mar 2 03:34:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:34:03.084020 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:03.085017 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Mar 02 03:34:03.085411 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:34:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:34:03.275100 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-2e2ecfdb-cf10-488c-8288-d653104f155f admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:03.276277 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:34:03.276277 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: warnings.warn(msg) Mar 02 03:34:03.277747 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-2e2ecfdb-cf10-488c-8288-d653104f155f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:03.278199 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-2e2ecfdb-cf10-488c-8288-d653104f155f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:03.279027 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-2e2ecfdb-cf10-488c-8288-d653104f155f admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:03.279503 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-2e2ecfdb-cf10-488c-8288-d653104f155f admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:03.298270 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-2e2ecfdb-cf10-488c-8288-d653104f155f admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073091 Mar 02 03:34:03.298807 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Mar 2 03:34:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:34:15.030917 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:15.031967 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Mar 02 03:34:15.032358 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:34:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:34:15.222750 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-d34a5b0d-5679-4431-a47c-f51a5ae61331 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:15.223961 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:34:15.223961 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: warnings.warn(msg) Mar 02 03:34:15.225160 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d34a5b0d-5679-4431-a47c-f51a5ae61331 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:15.225606 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d34a5b0d-5679-4431-a47c-f51a5ae61331 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:15.226407 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d34a5b0d-5679-4431-a47c-f51a5ae61331 admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:15.226840 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-d34a5b0d-5679-4431-a47c-f51a5ae61331 admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:15.251143 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-d34a5b0d-5679-4431-a47c-f51a5ae61331 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079265 Mar 02 03:34:15.251687 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 37/75] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Mar 2 03:34:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:34:16.568270 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: DEBUG nova.api.openstack.wsgi [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] Calling method '>' {{(pid=102548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:16.569280 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: INFO nova.api.openstack.requestlog [None req-ed922d09-e20b-46fd-80bb-3ea783125430 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Mar 02 03:34:16.569674 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: [pid: 102548|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Mar 2 03:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:34:16.763807 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG nova.api.openstack.wsgi [None req-1498e7ce-83aa-4d84-b549-db19bd7ff9b5 admin admin] Calling method '>' {{(pid=102547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:34:16.765773 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 02 03:34:16.765773 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: warnings.warn(msg) Mar 02 03:34:16.767272 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-1498e7ce-83aa-4d84-b549-db19bd7ff9b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:16.768141 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-1498e7ce-83aa-4d84-b549-db19bd7ff9b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:16.769098 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-1498e7ce-83aa-4d84-b549-db19bd7ff9b5 admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:34:16.769562 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: DEBUG oslo_concurrency.lockutils [None req-1498e7ce-83aa-4d84-b549-db19bd7ff9b5 admin admin] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:34:16.790570 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: INFO nova.api.openstack.requestlog [None req-1498e7ce-83aa-4d84-b549-db19bd7ff9b5 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077158 Mar 02 03:34:16.791039 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: [pid: 102547|app: 0|req: 38/77] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Mar 2 03:34:16 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:35:13.037071 dv-cinder-831090-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 02 03:35:13.037852 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: Wed Mar 2 03:35:13 2022 - graceful shutdown triggered... Mar 02 03:35:13.038326 dv-cinder-831090-3-iscsi devstack@n-api.service[102547]: Gracefully killing worker 1 (pid: 102547)... Mar 02 03:35:13.038687 dv-cinder-831090-3-iscsi devstack@n-api.service[102548]: Gracefully killing worker 2 (pid: 102548)... Mar 02 03:35:14.038411 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: worker 1 buried after 1 seconds Mar 02 03:35:14.038411 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: worker 2 buried after 1 seconds Mar 02 03:35:14.038981 dv-cinder-831090-3-iscsi devstack@n-api.service[102546]: goodbye to uWSGI. Mar 02 03:35:14.040022 dv-cinder-831090-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 02 03:35:14.040580 dv-cinder-831090-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 02 03:35:14.043364 dv-cinder-831090-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 02 03:35:14.060520 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Mar 2 03:35:14 2022] *** Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: nodename: dv-cinder-831090-3-iscsi Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: machine: x86_64 Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: clock source: unix Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: pcre jit disabled Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: detected number of CPU cores: 4 Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: current working directory: / Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: detected binary path: /usr/bin/uwsgi-core Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: your processes number limit is 47680 Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: your memory page size is 4096 bytes Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: detected max file descriptor number: 2048 Mar 02 03:35:14.080071 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: lock engine: pthread robust mutexes Mar 02 03:35:14.081555 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: thunder lock: enabled Mar 02 03:35:14.081555 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 02 03:35:14.081555 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 02 03:35:14.128497 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: Python main interpreter initialized at 0x55f04d1a29c0 Mar 02 03:35:14.128497 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: python threads support enabled Mar 02 03:35:14.128497 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: your server socket listen backlog is limited to 100 connections Mar 02 03:35:14.128497 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: your mercy for graceful operations on workers is 90 seconds Mar 02 03:35:14.128935 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: mapped 403077 bytes (393 KB) for 2 cores Mar 02 03:35:14.128935 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: *** Operational MODE: preforking *** Mar 02 03:35:14.129191 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: *** uWSGI is running in multiple interpreter mode *** Mar 02 03:35:14.129191 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: spawned uWSGI master process (pid: 123408) Mar 02 03:35:14.129399 dv-cinder-831090-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 02 03:35:14.129981 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: spawned uWSGI worker 1 (pid: 123425, cores: 1) Mar 02 03:35:14.130540 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: spawned uWSGI worker 2 (pid: 123426, cores: 1) Mar 02 03:35:14.130845 dv-cinder-831090-3-iscsi devstack@n-api.service[123408]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 02 03:35:16.037453 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:35:16.037453 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: from cryptography.utils import int_from_bytes Mar 02 03:35:16.038184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:35:16.038184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: from cryptography.utils import int_from_bytes Mar 02 03:35:16.050007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:35:16.050007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: from cryptography.utils import int_from_bytes Mar 02 03:35:16.050627 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 02 03:35:16.050627 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: from cryptography.utils import int_from_bytes Mar 02 03:35:18.417601 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 02 03:35:18.418164 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 02 03:35:18.418633 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 02 03:35:18.419002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 02 03:35:18.419294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 02 03:35:18.419684 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.420014 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.420343 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.420666 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.420999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.421316 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.421651 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.421976 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.422322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.422590 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.422923 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.423294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831090-3-iscsi {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.423628 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.423957 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.424272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.424596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.424909 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.425238 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.425550 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.426059 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.427269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.427269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.427456 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.427788 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.428127 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.428468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.428797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.429113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.429444 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.429760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.430165 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831090-3-iscsi {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.430488 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.430810 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.431168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.431583 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.431902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.432228 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.432654 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.432992 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.433285 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.433632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.433974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.434302 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.434632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.434953 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.435294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.435611 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.435938 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.436250 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.436560 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.436817 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.437129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.437459 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.437788 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.438118 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.438383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.438639 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.438967 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.439320 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.439633 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.439947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.440260 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.440572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.440884 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.441195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.441506 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.441829 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.442145 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.442466 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.442794 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.443131 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.443459 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.443863 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.444120 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.444435 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.444782 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.445107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.445423 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.445749 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.446072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.446385 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.446697 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.447007 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.447359 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.447700 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.448009 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.448268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.448579 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.449400 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.449739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.450118 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.450430 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.450742 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.451145 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.451257 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 02 03:35:18.451660 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 02 03:35:18.451759 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.451759 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.451921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 02 03:35:18.452011 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.452216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 02 03:35:18.452325 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.452480 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 02 03:35:18.452648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.452872 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.452971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.453185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.453286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.453495 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.453585 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.453806 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.453905 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.454275 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.454381 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.454473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.454564 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.454739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.454839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.455065 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.455159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.455384 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.455486 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.455696 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.455785 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.456020 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.456110 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.456334 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.456469 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831090-3-iscsi {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.456659 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.456767 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.456986 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.457087 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.457296 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.457436 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.457675 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.457960 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.458115 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.458299 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.458459 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.458610 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.458750 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.458934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.459129 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.459297 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.459450 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.459598 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.459739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.459878 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.460049 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.460206 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.460398 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.460553 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.460717 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.461910 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462082 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462182 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462444 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462721 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462828 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.462921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.463005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.463005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.464030 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831090-3-iscsi {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.464455 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.465455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.465615 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.465707 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.465786 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.465857 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466027 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466027 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466179 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466179 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466320 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466404 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466482 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466482 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.466745 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.466837 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.466921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.467017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.467133 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.467229 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.467318 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.467451 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.467581 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.467678 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.467764 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.467952 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.468043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.468271 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.468370 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.468591 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.468689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.468929 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.469031 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.469247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.469351 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.469561 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.469671 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.469875 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.469967 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.470133 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.470236 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.470453 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.470586 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.470791 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.470889 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.471152 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.471277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.471472 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.471563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.471734 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.471833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.471995 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.472094 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.472328 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.472471 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.472662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.472804 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.472982 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.473084 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.473300 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.473399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.473623 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.473766 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.473942 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.474043 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.474258 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.474350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.474576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.474750 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.474893 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.474995 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.475231 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.475395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.475550 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.475650 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.475866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.475956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.476192 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.476293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.476505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.476608 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.476824 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.476912 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.477144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.477287 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.477459 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.477559 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.477775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.477877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.478088 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.478180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.478402 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.478494 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.478721 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.478812 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.479081 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.479186 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.479393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.479483 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.479713 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.479811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.480029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.480145 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.480423 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.480578 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.480749 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.480916 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.481045 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.481270 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.481372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.481587 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.481685 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.481847 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.481948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.482162 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.482254 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.482478 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.482575 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.482809 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.482910 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.483155 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.483249 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.483458 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.483559 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.483775 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.483920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.484087 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.484185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.484405 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.484495 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.484715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.484813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.485027 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.485120 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.485337 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.485427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.485648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.485749 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.485960 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.486053 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.486269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.486367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.486583 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.486735 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.486891 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.486999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.487260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.487498 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.487598 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.487691 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.487891 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.488022 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.488201 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.488298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.488510 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.488614 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.488834 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.488927 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.489146 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.489249 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.489473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.489567 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.489787 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.489889 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.490187 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.490278 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.490414 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.490513 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.490808 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.490977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.491120 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.491483 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.491483 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.491679 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.491757 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.491835 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.492001 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.492099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.492326 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.492439 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.492811 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.492915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.493226 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.493335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.493411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.493491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.493790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.494305 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.494305 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.494472 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.494552 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.494631 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.494710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.495044 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.495168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.495300 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.495389 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.495661 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.495805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.496077 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.496315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.496605 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.496749 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.496934 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.497356 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.497356 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.497606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.497727 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.497847 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.497973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.498161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.498276 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.498395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.498526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.498639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.498870 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.499024 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 02 03:35:18.499277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.499462 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.499673 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.499888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.500047 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.500208 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.500363 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.500508 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.500652 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.500810 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.500967 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.501120 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.501272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.501416 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.501560 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.501704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.501862 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.502008 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.502154 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.502305 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.502620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.502790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.503550 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.503710 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.503866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.504018 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.504163 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.504310 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.504464 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.504609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.504753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.504904 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.505057 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.505201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.505355 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.505511 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.505681 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.505899 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.506048 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.506209 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.506364 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.506509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.506653 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.506805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.506949 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.507151 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.507318 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.507472 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.507629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.507629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.507901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.507901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.508182 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.508182 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.508453 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.508596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.508739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.508896 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.509048 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.509193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.509346 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.509490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.509642 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.509795 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.509947 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.510099 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.510252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.510397 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.510551 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.510696 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.510849 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.510994 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.511191 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.511352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.512039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.512422 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.512748 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.513270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.513505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.513989 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.513989 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.514296 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.514455 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.514609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.514756 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.514933 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.517168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.517368 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.517520 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.517666 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.517810 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.517968 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.518113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.518257 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.518401 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.518553 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.518810 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.518994 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.519177 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.519337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.519482 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.519625 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.519769 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.519922 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.520069 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.520221 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.520382 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.520528 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.520687 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.520833 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.520978 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.521134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.521287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.521287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.521608 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.521762 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.521906 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.522059 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.522222 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.522222 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.522836 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.523011 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.523447 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.523674 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524013 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524148 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524283 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524404 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524517 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524636 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524757 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524870 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.524992 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525105 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525217 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525329 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525441 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525567 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525689 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525801 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.525911 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.526031 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.526152 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.526288 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.526658 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.526811 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.526957 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.527759 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.527929 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.528090 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.528307 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.528307 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.528595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.528595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.528867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.529025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.529171 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.529171 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.529460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.529612 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.529771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.529925 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.530099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.530414 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.530577 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.530731 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.530891 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.531037 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.531219 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.531364 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.531519 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.531708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.531867 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.532012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.532156 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.532312 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.532457 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.532611 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.532842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.533084 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.533279 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.533279 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.533809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.534174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.534174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.534461 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.534606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.534758 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.534923 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535104 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535256 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535416 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535844 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535998 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.535998 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.536271 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.536413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.536642 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.536808 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.536965 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.537117 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.537269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.537414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.537568 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.537713 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.537866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.538011 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.538166 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.538166 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.538483 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.538483 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.538933 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.539099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.539250 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.539412 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.539558 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.539701 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.539854 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.540000 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.540164 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.540309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.540453 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.540596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.540739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.540901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.541061 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.541205 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.541349 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.541491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.541643 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.541797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.541950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.542097 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.542248 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.542391 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.542543 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.542734 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.542905 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.542905 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.543283 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.543445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.543814 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.543982 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.544148 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.544474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.544627 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.544773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.544917 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.544917 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.545207 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.545362 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.545514 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.545659 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.545818 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.545976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.546121 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.546273 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.546419 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.546561 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.546797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.546958 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.547190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.547190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.547190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.547639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.547639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.547639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.548057 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.548200 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.548344 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.548344 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.548671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.548825 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.548992 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.549191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.549316 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.549428 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.549630 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.549874 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.550030 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.550184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.550336 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.550482 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.550681 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.550845 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.550990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.551171 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.551318 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.551487 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.551633 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.551633 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.551949 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.552093 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.552237 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.552390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.552544 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.552688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.552832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.552976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.553214 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.553481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.553481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.554119 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.554281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.554657 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.554820 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.554949 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.555164 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.555322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.555472 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.555637 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.555799 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.555958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.556746 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.557029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.557204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.557394 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.557563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.557718 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.557877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.558029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.558216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.558416 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.558580 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.558580 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.558888 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.559079 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.559238 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.559401 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.559569 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.559720 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.559720 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.560093 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.560306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.560479 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.560642 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.560765 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.561222 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.561222 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.561602 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.561785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.561950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.562111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.562271 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.562460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.562616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.562797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.562797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.563157 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.563316 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.563581 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.563751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.564224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.564224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.564532 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.564532 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.565035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.565204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.565371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.565568 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.565734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.565887 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.566039 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.566201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.566354 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.566526 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.566526 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.566821 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.566973 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.567248 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.567559 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.567762 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.567924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.568077 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.568230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.568390 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.568551 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.568712 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.568888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.568888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.569184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.569347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.569507 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.569507 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.569833 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.569984 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.570146 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.570298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.570449 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.570607 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.570777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.570777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.571225 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.571451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.571615 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.571813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.571971 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.572123 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.572290 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.572451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.572603 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.572753 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.572919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.573108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.573263 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.573423 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.573594 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.573824 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.574691 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.574879 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.575268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.575442 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.575597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.575763 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.575950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.576107 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.576273 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.576432 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.576432 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.576740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.576900 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.577052 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.577222 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.577443 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.577611 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.577765 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.577924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.578083 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.578236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.578399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.578565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.578733 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.578885 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.579043 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.579232 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.579384 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.579550 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.579712 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.579871 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580058 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580379 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580845 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580997 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.580997 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.581293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.581470 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.581697 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.581856 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.582008 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.582169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.582332 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.582505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.582665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.582818 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.582970 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.583160 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.583335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.583498 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.583650 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.583828 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.584087 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.584257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.584420 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.584779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.584961 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.585123 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.585479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.585649 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.585804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.585956 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.586118 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.586278 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.586438 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.586602 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.586755 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.586907 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.587097 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.587257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.587439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.587439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.587822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.587977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.588167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.588325 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.588486 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.588648 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.588808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.588968 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.589368 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.589621 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.590297 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.590460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.590613 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.590771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.590934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.591137 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.591313 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.591476 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.591629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.591877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.592037 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.592198 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.592379 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.592540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.592700 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.592860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.593013 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.593184 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.593352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.593505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.593656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.593817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.593970 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.594223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.594223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.594546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.594726 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.595120 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.595283 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.595661 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.595823 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.595976 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.596129 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.596324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.596489 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.596725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.596888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.597052 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.597216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.597369 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.597529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.597710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.597938 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.598095 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.598245 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.598404 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.598404 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.598708 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.598858 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.599009 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.599197 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.599350 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.599587 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.599769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.599931 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.600091 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.600244 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.600395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.600561 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.600715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.600867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.601019 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.601019 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.601317 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.601478 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.601630 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.601788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.602029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.602188 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.602350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.602512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.602665 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.602826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.602985 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.603201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.603367 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.603539 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.603701 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.603701 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.603997 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.604157 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.604447 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.604616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.604768 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.604945 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.605358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.605521 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.605892 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.606073 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.606236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.606403 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.606563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.606732 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.606893 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.607063 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.607224 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.607388 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.607541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.607708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.607874 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.608112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.608282 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.608443 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.608605 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.608605 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.608909 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.608909 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.609215 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.609375 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.609533 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.609696 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.609848 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.610000 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.610162 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.610324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.610486 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.610638 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.610789 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.610789 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.611113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.611286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.611449 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.611609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.611776 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.611928 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.612183 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.612344 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.612552 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.612712 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.612878 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.613041 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.613203 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.613357 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.613524 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.613694 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.613861 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.614013 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.614175 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.614336 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.614582 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.614582 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.614582 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.615038 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.615534 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.615700 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.616056 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.616226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.616380 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.616552 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.616870 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.617029 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.617189 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.617353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.617519 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.617680 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.617833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.617984 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.618156 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.618387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.618555 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.618720 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.618958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.619322 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.619480 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.619643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.619815 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.619978 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.620131 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.620290 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.620442 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.620637 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.620832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.621061 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.621216 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.621368 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.621596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.621758 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.621926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.622091 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.622342 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.622502 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.622654 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.622826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.622996 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.623185 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.623348 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.623499 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.623651 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.623804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.623974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.624141 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.624294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.624454 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.624627 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.624866 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.625035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.625188 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.625340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.625732 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.625904 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.626297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.626466 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.626621 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.626785 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.626938 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.627148 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.627320 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.627474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.627634 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.627786 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.627938 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.628091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.628256 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.628509 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.628669 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.628830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.629003 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.629168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.629321 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.629474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.629625 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.629776 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.629936 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.630099 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.630252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.630411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.630572 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.630731 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.630894 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.631078 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.631239 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.631391 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.631542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.631927 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.632088 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.632257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.632257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.632643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.632820 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.632983 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.633144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.633317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.633471 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.633623 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.633774 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.633933 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.634096 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.634259 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.634419 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.634584 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.634737 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.634992 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.635194 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.635369 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.635536 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.635923 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.636105 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.637108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.637355 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.637542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.637707 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.637860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.638066 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.638241 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.638410 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.638677 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.638846 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.639025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.639237 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.639401 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.639556 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.639710 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.639893 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.640053 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.640249 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.640408 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.640562 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.640724 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.640889 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.641052 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.641225 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.641379 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.641539 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.641693 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.641859 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.642053 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.642253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.642413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.642413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.642834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.643023 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.643255 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.643410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.643563 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.643716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.643869 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.644027 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.644195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.644381 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.644539 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.644692 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.644854 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.645092 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.645272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.645426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.645588 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.645741 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.646132 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.646293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.646592 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.646762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.646919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.647214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.647376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.647544 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.647698 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.647877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.648031 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.648235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.648394 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.648591 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.648835 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.648995 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.649159 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.649356 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.649356 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.649709 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.649873 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.650040 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.650193 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.650389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.650389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.650707 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.650707 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.651008 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.651186 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.651340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.651563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.651751 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.651905 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.652707 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.652891 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.653045 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.653210 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.653210 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.653516 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.653667 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.653820 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.653971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.654138 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.654292 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.654456 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.654617 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.654777 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.654953 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.655243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.655406 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.655559 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.655710 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.655710 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.656247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.656414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.656585 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.656864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657034 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657385 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657485 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657568 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657751 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657834 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.657999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.658161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.658313 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.658467 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.658635 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.658815 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.659068 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.659232 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.659397 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.659560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.659714 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.659880 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.660044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.660209 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.660362 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.660514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.660666 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.660830 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.661031 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.661202 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.661376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.661537 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.661690 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.661851 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.662004 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.662156 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.662315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.662468 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.662468 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.662812 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.663086 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.663267 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.663429 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.663603 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.663769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.663923 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.664075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.664227 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.664378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.664530 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.664696 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.664849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.665043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.665228 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.665459 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.665637 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.665887 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.666044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.666541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.666710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.666892 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.667181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.667490 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.667740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.668505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.668681 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.668845 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.669030 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.669266 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.669425 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.669578 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.669739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.669906 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670073 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670378 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.670842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.671640 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.671803 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.671956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.672109 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.672268 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.672429 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.672582 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.672760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.672922 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.673189 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.673349 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.673513 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.673676 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.673838 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.673991 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.674144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.674304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.674470 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.674638 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.674792 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.674952 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.675122 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.675308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.675491 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.675695 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.675860 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.675860 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.676158 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.676313 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.676765 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.676934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.677100 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.677364 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.677540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.677540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.677853 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.677853 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.678144 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.678308 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.678461 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.678620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.678787 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.678940 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.679157 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.679399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.679565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.679729 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.679901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.680063 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.680223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.680391 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.680544 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.680706 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.680857 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.681019 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.681216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.681382 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.681536 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.681704 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.681704 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.682028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.682181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.682332 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.682484 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.682656 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.682820 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.682981 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.683186 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.683516 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.683692 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.683855 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.684019 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.684185 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.684338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.684338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.684651 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.684812 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.684965 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.685117 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.685268 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.685429 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.685594 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.685757 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.685910 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.686082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.686235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.686402 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.686574 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.687024 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.687024 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.687369 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.687626 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.687801 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.687955 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.688107 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.688259 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.688411 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.688582 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.688745 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.688899 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.689051 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.689202 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.689414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.689638 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.689810 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.689973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.690134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.690295 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.690454 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.690616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.690780 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.690934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.691109 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.691369 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.691553 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.691722 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.691876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.692029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.692189 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.692348 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.692509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.692678 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.692835 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.693009 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.693170 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.693323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.693500 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.693740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.693900 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.693900 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.694197 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.694348 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.694514 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.694667 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.694827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.694997 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.695174 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.695327 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.695496 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.695649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.695809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.695970 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.696131 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.696292 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.696454 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.696613 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.696782 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.697220 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.697425 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.697611 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.697868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.698036 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.698192 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.698344 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.698497 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.698730 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.699446 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.699446 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.699446 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.700110 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.700274 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.700456 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.700619 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.700773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.700926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.701078 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.701230 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.701392 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.701552 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.701552 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.701840 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.701993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.702153 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.702324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.702480 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.702632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.702783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.702935 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.703142 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.703311 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.703466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.703618 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.703859 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.704018 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.704185 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.704340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.704506 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.704660 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.704819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.704972 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.705137 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.705290 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.705441 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.705594 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.705754 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.705916 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.706068 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.706068 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.706464 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.706643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.706797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.707273 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.707451 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.707614 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.707778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708041 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.708514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.709688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.710946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.712154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.714337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.716147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.717921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.719426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.720704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.721842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.721842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.721842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.721842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.721842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.721842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.721842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_db.sqlalchemy.engines [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.723409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.724716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.725862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.725862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.725862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.725862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.725862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.726609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 02 03:35:18.726609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 02 03:35:18.750374 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_db.sqlalchemy.engines [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:18.783541 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.context [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ec61a67-357a-4a65-915a-6ee9dabb36ce(cell1) {{(pid=123425) load_cells /opt/stack/nova/nova/context.py:464}} Mar 02 03:35:18.787775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:35:18.789372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:35:18.790185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:35:18.792169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:35:18.802873 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_db.sqlalchemy.engines [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:18.803734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_db.sqlalchemy.engines [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:18.817217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.context [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ec61a67-357a-4a65-915a-6ee9dabb36ce(cell1) {{(pid=123426) load_cells /opt/stack/nova/nova/context.py:464}} Mar 02 03:35:18.821407 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:35:18.823018 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:35:18.824051 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:35:18.826630 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:35:18.837285 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_db.sqlalchemy.engines [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:18.838650 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_db.sqlalchemy.engines [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:18.962171 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_db.sqlalchemy.engines [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:19.000171 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_db.sqlalchemy.engines [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 02 03:35:19.276807 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: WARNING keystonemiddleware.auth_token [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:35:19.322501 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: WARNING keystonemiddleware.auth_token [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:35:19.398597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: WARNING keystonemiddleware.auth_token [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:35:19.443412 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: WARNING keystonemiddleware.auth_token [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:35:19.624298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: WARNING keystonemiddleware.auth_token [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:35:19.629400 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: WARNING keystonemiddleware.auth_token [None req-22ba9f5e-6a6d-41b3-8b36-22f5b8d6380f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:35:19.634698 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f04d1a29c0 pid: 123425 (default app) Mar 02 03:35:19.670767 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: WARNING keystonemiddleware.auth_token [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 02 03:35:19.676117 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: WARNING keystonemiddleware.auth_token [None req-088c8f70-6540-4b32-b1ab-6654c6fa5b78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 02 03:35:19.681459 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f04d1a29c0 pid: 123426 (default app) Mar 02 03:35:59.172845 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-37248ea2-0190-45aa-997f-c07c5cbc7397 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Action: 'create', calling method: .version_select at 0x7fc38dc274c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-813198327", "metadata": {"Type": "work"}}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:35:59.797483 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-820f02d9-b9a2-4a9f-872a-cb011812f942 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Action: 'create', calling method: .version_select at 0x7fc38dc274c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1627102034", "metadata": {"Type": "work"}}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:35:59.799312 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-820f02d9-b9a2-4a9f-872a-cb011812f942 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:35:59.800238 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-820f02d9-b9a2-4a9f-872a-cb011812f942 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.359848 Mar 02 03:35:59.801288 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Mar 2 03:35:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1362 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:36:00.254265 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b31de419-9cc8-44b7-adac-9b11b907efcd tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Action: 'create', calling method: .version_select at 0x7fc38dbe6310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-484467290"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:01.497049 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-37248ea2-0190-45aa-997f-c07c5cbc7397 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.431989 Mar 02 03:36:01.498356 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Mar 2 03:35:58 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 02 03:36:01.504170 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c855d1c1-bc4f-4cfb-83cb-67d182a30b3f tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Action: 'create', calling method: .version_select at 0x7fc38daf0430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2141357139", "metadata": {"Type": "work"}}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:01.511013 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c855d1c1-bc4f-4cfb-83cb-67d182a30b3f tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:01.511925 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c855d1c1-bc4f-4cfb-83cb-67d182a30b3f tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012216 Mar 02 03:36:01.512481 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Mar 2 03:36:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:36:01.925367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b31de419-9cc8-44b7-adac-9b11b907efcd tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.122497 Mar 02 03:36:01.926153 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 2/4] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Mar 2 03:35:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2124 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 02 03:36:01.932509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2c0f4725-3983-4460-82c4-40b0e7701167 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38daf69d0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:01.995025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2c0f4725-3983-4460-82c4-40b0e7701167 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 352 microversion: 2.1 time: 0.067263 Mar 02 03:36:01.995895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:01 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:02.001309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9c6ab276-7798-41c0-a002-bd9d9d1464d3 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Action: 'create', calling method: .version_select at 0x7fc38dbe70d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1974002940", "metadata": {"Type": "work"}}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:02.002529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9c6ab276-7798-41c0-a002-bd9d9d1464d3 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:02.004213 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9c6ab276-7798-41c0-a002-bd9d9d1464d3 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007226 Mar 02 03:36:02.010025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 4/6] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Mar 2 03:36:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:36:02.014906 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2bb59c54-21ad-4ce5-bc48-d7dfa907e144 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38dbe7ee0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:02.038399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-574493713", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "fad69f68-5001-4cf9-8d95-506b927650c5"}]}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:02.075509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2bb59c54-21ad-4ce5-bc48-d7dfa907e144 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0" status: 200 len: 344 microversion: 2.1 time: 0.064183 Mar 02 03:36:02.076588 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 5/7] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:02 2022] GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:02.082276 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d1917406-0fbc-4864-984a-80548c1ef4d5 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Calling method '.version_select at 0x7fc38dbe7670>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:02.111230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-d1917406-0fbc-4864-984a-80548c1ef4d5 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] HTTP exception thrown: Volume tempest-invalid-41112023 could not be found. Mar 02 03:36:02.112485 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d1917406-0fbc-4864-984a-80548c1ef4d5 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Returning 404 to user: Volume tempest-invalid-41112023 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:02.113616 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d1917406-0fbc-4864-984a-80548c1ef4d5 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-41112023" status: 404 len: 97 microversion: 2.1 time: 0.034860 Mar 02 03:36:02.114473 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1211 bytes} [Wed Mar 2 03:36:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-41112023 => generated 97 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 02 03:36:02.125052 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-eb602512-9f72-4e41-bf21-ab73d29b9fc9 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004127 Mar 02 03:36:02.127330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 7/9] 10.222.0.23 () {58 vars in 1139 bytes} [Wed Mar 2 03:36:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 02 03:36:02.136617 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4d07112a-b6e7-4102-b801-d15550c7972d tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004313 Mar 02 03:36:02.137111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 8/10] 10.222.0.23 () {58 vars in 1136 bytes} [Wed Mar 2 03:36:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 02 03:36:02.148379 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2216202b-8349-4bf3-8123-649c83153045 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Calling method '.version_select at 0x7fc38dbe7670>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:02.185342 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-2216202b-8349-4bf3-8123-649c83153045 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] HTTP exception thrown: Volume e194b520-2452-4ae3-9e0a-75722e64bec8 could not be found. Mar 02 03:36:02.186060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2216202b-8349-4bf3-8123-649c83153045 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Returning 404 to user: Volume e194b520-2452-4ae3-9e0a-75722e64bec8 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:02.187126 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2216202b-8349-4bf3-8123-649c83153045 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e194b520-2452-4ae3-9e0a-75722e64bec8" status: 404 len: 109 microversion: 2.1 time: 0.042751 Mar 02 03:36:02.187861 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 9/11] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Mar 2 03:36:02 2022] DELETE /compute/v2.1/os-volumes/e194b520-2452-4ae3-9e0a-75722e64bec8 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:36:02.194896 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] validate_networks() for [('fad69f68-5001-4cf9-8d95-506b927650c5', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:36:02.196821 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4dd82e10-cfb4-4155-9c60-471035180291 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Calling method '.version_select at 0x7fc38daf6af0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:02.238167 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-4dd82e10-cfb4-4155-9c60-471035180291 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] HTTP exception thrown: Volume b8d74605-ad58-4426-84df-6f18cbde5cd2 could not be found. Mar 02 03:36:02.238909 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4dd82e10-cfb4-4155-9c60-471035180291 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] Returning 404 to user: Volume b8d74605-ad58-4426-84df-6f18cbde5cd2 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:02.239932 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4dd82e10-cfb4-4155-9c60-471035180291 tempest-VolumesNegativeTest-564850516 tempest-VolumesNegativeTest-564850516-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b8d74605-ad58-4426-84df-6f18cbde5cd2" status: 404 len: 109 microversion: 2.1 time: 0.046903 Mar 02 03:36:02.240651 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 10/12] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:02 2022] GET /compute/v2.1/os-volumes/b8d74605-ad58-4426-84df-6f18cbde5cd2 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:36:03.011334 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-94fb7005-5150-41b7-aa86-0f9f91378548 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38dbe7550>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:03.102115 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-94fb7005-5150-41b7-aa86-0f9f91378548 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 353 microversion: 2.1 time: 0.098695 Mar 02 03:36:03.102698 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 11/13] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:03 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:03.115186 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-990d9410-8bdf-4261-bb9c-06056c9c84cc tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38e120dc0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:03.227501 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-990d9410-8bdf-4261-bb9c-06056c9c84cc tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0" status: 200 len: 345 microversion: 2.1 time: 0.116481 Mar 02 03:36:03.228103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 12/14] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:03 2022] GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:03.235005 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-09581bd1-532f-49fa-95c7-ec9cbbc1ea9e tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38daf6b80>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:03.345106 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-09581bd1-532f-49fa-95c7-ec9cbbc1ea9e tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 353 microversion: 2.1 time: 0.115973 Mar 02 03:36:03.353836 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 13/15] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:03 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:03.359175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8b1d65e3-543b-4807-9794-a3a47a1115b9 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Action: 'create', calling method: .version_select at 0x7fc38dbe79d0>, body: {"snapshot": {"volume_id": "e2275bd2-4617-4a2a-bfc8-9fea2046bdb0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-698642667"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:03.717811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:36:03.718388 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:36:03.718720 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:36:03.726632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:36:03.728202 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:36:03.777212 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:03.786243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:03.796816 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:03.797382 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:03.824859 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8b1d65e3-543b-4807-9794-a3a47a1115b9 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.469624 Mar 02 03:36:03.827263 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 14/16] 10.222.0.23 () {60 vars in 1161 bytes} [Wed Mar 2 03:36:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:03.833806 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-376303bc-a1c3-4dcf-b004-11c3705c9582 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38dbe7e50>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:03.905974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Getting quotas for project b3c8fe4c2483453594312bc39df134c3. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:36:03.912758 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Getting quotas for user 4e231ec8b5b94979941284ffed81a2e0 and project b3c8fe4c2483453594312bc39df134c3. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:36:03.942549 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:36:03.945352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:36:04.000276 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-376303bc-a1c3-4dcf-b004-11c3705c9582 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 202 len: 0 microversion: 2.1 time: 0.170457 Mar 02 03:36:04.002514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 15/17] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Mar 2 03:36:03 2022] DELETE /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:36:04.008306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ca62bc27-6e68-4b07-b8d7-7fb9500fe6a5 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38dc27dc0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:04.084821 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ca62bc27-6e68-4b07-b8d7-7fb9500fe6a5 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 286 microversion: 2.1 time: 0.080894 Mar 02 03:36:04.086584 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 16/18] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:04 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:04.093350 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-971ed8c2-7781-4b0a-a4a0-ea43cd9811fb tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38daf6820>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:04.131809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cbfeb95e-d060-4766-a0de-be00ffef5cb7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611254 Mar 02 03:36:04.138206 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 3/19] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:36:04.143461 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-395bee85-9fed-45d6-bc01-b1d96e6c60c3 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38da05dc0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:04.224968 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-971ed8c2-7781-4b0a-a4a0-ea43cd9811fb tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 352 microversion: 2.1 time: 0.135792 Mar 02 03:36:04.225709 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 17/20] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:04 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:04.226549 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-395bee85-9fed-45d6-bc01-b1d96e6c60c3 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.087036 Mar 02 03:36:04.230708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 4/21] 10.222.0.23 () {58 vars in 1139 bytes} [Wed Mar 2 03:36:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:04.233281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-de51388c-3236-41ef-9261-3f7b251a5c02 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:04.234103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-de51388c-3236-41ef-9261-3f7b251a5c02 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:04.242253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f3ba4a8c-f8d2-4b5b-a42e-49cd22a7c010 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38da05d30>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:04.428136 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f3ba4a8c-f8d2-4b5b-a42e-49cd22a7c010 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 286 microversion: 2.1 time: 0.190986 Mar 02 03:36:04.428716 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 5/22] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:04 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:36:04.473382 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-de51388c-3236-41ef-9261-3f7b251a5c02 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:04.490504 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-de51388c-3236-41ef-9261-3f7b251a5c02 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1214 microversion: 2.1 time: 0.263155 Mar 02 03:36:04.491503 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 18/23] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:04 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:05.242673 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0d3e0f3d-0ecd-4b2b-b386-8c94c36d3838 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38c99d700>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:05.399775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0d3e0f3d-0ecd-4b2b-b386-8c94c36d3838 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 352 microversion: 2.1 time: 0.165225 Mar 02 03:36:05.400839 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 6/24] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:05 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 352 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:05.441437 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-41c9f188-cdb5-4827-beac-b14e88098237 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38daa6b80>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:05.509776 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-34ff1eaa-e005-41fe-9ca1-3f381818b652 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:05.511798 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-34ff1eaa-e005-41fe-9ca1-3f381818b652 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:05.513178 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-41c9f188-cdb5-4827-beac-b14e88098237 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 286 microversion: 2.1 time: 0.075175 Mar 02 03:36:05.515185 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 19/25] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:05 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:05.869412 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-34ff1eaa-e005-41fe-9ca1-3f381818b652 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:05.893812 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-34ff1eaa-e005-41fe-9ca1-3f381818b652 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1214 microversion: 2.1 time: 0.388567 Mar 02 03:36:05.903152 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 7/26] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:05 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1214 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:06.412474 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5145b37a-fe4c-4317-b316-7099b89f4016 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38dadd310>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:06.505371 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5145b37a-fe4c-4317-b316-7099b89f4016 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 352 microversion: 2.1 time: 0.096607 Mar 02 03:36:06.511435 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 20/27] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:06 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:06.529556 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a5ab93fa-f0f9-4676-b538-9145346a374b tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38c9a8310>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:06.580710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a5ab93fa-f0f9-4676-b538-9145346a374b tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 286 microversion: 2.1 time: 0.058458 Mar 02 03:36:06.581286 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 8/28] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:06 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:06.910690 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:06.911347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:06.927208 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:06.927989 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:06.929260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:06.930042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:07.338934 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:07.360979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d5861ba4-f0ad-4b4d-ad3b-a6ef01e098ac tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1218 microversion: 2.1 time: 0.452505 Mar 02 03:36:07.375399 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 21/29] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:06 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1218 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:07.522589 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-072ea189-bee1-4fc4-8ad6-e6e9822003b9 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38c9c38b0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:07.598990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-05fa157e-7dd3-433c-b0b2-934861c0a70e tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38da4f790>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:07.719602 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-05fa157e-7dd3-433c-b0b2-934861c0a70e tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 287 microversion: 2.1 time: 0.129725 Mar 02 03:36:07.720234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 22/30] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:07 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:07.732513 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-072ea189-bee1-4fc4-8ad6-e6e9822003b9 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 352 microversion: 2.1 time: 0.217450 Mar 02 03:36:07.734575 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 9/31] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:07 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 352 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:07.740852 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-68c013b4-d75c-41b9-baed-8b9ce11883d7 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38da57310>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:07.872962 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-68c013b4-d75c-41b9-baed-8b9ce11883d7 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 202 len: 0 microversion: 2.1 time: 0.140431 Mar 02 03:36:07.873924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 23/32] 10.222.0.23 () {58 vars in 1253 bytes} [Wed Mar 2 03:36:07 2022] DELETE /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:36:07.883128 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0f109791-fe82-4010-8f7c-fa9d0603d866 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38c9cc040>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:07.942470 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0f109791-fe82-4010-8f7c-fa9d0603d866 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 286 microversion: 2.1 time: 0.063806 Mar 02 03:36:07.948400 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 10/33] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:07 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:08.381309 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:08.382003 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:08.389373 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:08.389810 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:08.390842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:08.391438 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:08.560748 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:08.573822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b34018ae-d4af-4609-b577-a1a65ba88eee tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1266 microversion: 2.1 time: 0.198275 Mar 02 03:36:08.574839 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 11/34] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:08 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:08.713832 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2a2c88b7-0768-43bf-9f17-c14821d5d858 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'create', calling method: .version_select at 0x7fc38da4fd30>, body: {"keypair": {"name": "tempest-keypair-1678821105"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:08.746644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-14309ba0-64bd-4010-a612-0b573807a274 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38c93aa60>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:08.796613 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-2a2c88b7-0768-43bf-9f17-c14821d5d858 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:36:08.805677 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-2a2c88b7-0768-43bf-9f17-c14821d5d858 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for user b101d4fa905743eb944d80e401ee5768 and project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:36:08.844873 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-14309ba0-64bd-4010-a612-0b573807a274 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 352 microversion: 2.1 time: 0.102649 Mar 02 03:36:08.845913 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 12/35] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:08 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:36:08.956092 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b03df9dc-a082-4384-b22f-4711f4c2c7e4 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38c9498b0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:08.994114 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b03df9dc-a082-4384-b22f-4711f4c2c7e4 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 286 microversion: 2.1 time: 0.041632 Mar 02 03:36:08.994693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 13/36] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:08 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:36:09.033236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-2a2c88b7-0768-43bf-9f17-c14821d5d858 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:36:09.038305 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-2a2c88b7-0768-43bf-9f17-c14821d5d858 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for user b101d4fa905743eb944d80e401ee5768 and project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:36:09.069804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2a2c88b7-0768-43bf-9f17-c14821d5d858 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.711102 Mar 02 03:36:09.072553 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 24/37] 10.222.0.23 () {60 vars in 1157 bytes} [Wed Mar 2 03:36:08 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:09.591833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:09.598872 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:09.620437 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:09.620974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:09.621871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:09.622452 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:09.776721 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:09.796420 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a09e381a-a855-4ee0-9b69-ff0735397bd0 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1266 microversion: 2.1 time: 0.207565 Mar 02 03:36:09.806650 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 14/38] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:09 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:09.859212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7d421535-e2f8-40ef-8929-59a2504cfc99 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38d960e50>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:09.945717 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7d421535-e2f8-40ef-8929-59a2504cfc99 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 200 len: 352 microversion: 2.1 time: 0.090793 Mar 02 03:36:09.948100 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 25/39] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:09 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:10.012108 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b0047cbf-b5d6-43e8-b619-55095dd36979 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38c9c3ee0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:10.070422 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b0047cbf-b5d6-43e8-b619-55095dd36979 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 200 len: 286 microversion: 2.1 time: 0.065394 Mar 02 03:36:10.071926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 15/40] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:10 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:10.815573 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:10.816773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:10.831543 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:10.833218 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:10.836029 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:10.838647 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:10.960685 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5b1f8fb5-2ce1-475f-9ac2-f9555c72d1c4 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Calling method '.version_select at 0x7fc38c8eff70>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:11.011171 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:11.022608 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b1d5f855-62fc-4d09-bf5d-987ab381d003 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1274 microversion: 2.1 time: 0.212260 Mar 02 03:36:11.025775 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 26/41] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:10 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:11.041633 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-5b1f8fb5-2ce1-475f-9ac2-f9555c72d1c4 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] HTTP exception thrown: Volume 272e4aee-e68f-4af4-b9c5-0e63e9b2f61b could not be found. Mar 02 03:36:11.042245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5b1f8fb5-2ce1-475f-9ac2-f9555c72d1c4 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] Returning 404 to user: Volume 272e4aee-e68f-4af4-b9c5-0e63e9b2f61b could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:11.043103 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5b1f8fb5-2ce1-475f-9ac2-f9555c72d1c4 tempest-VolumesGetTestJSON-1596709655 tempest-VolumesGetTestJSON-1596709655-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b" status: 404 len: 109 microversion: 2.1 time: 0.086467 Mar 02 03:36:11.044126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 16/42] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:10 2022] GET /compute/v2.1/os-volumes/272e4aee-e68f-4af4-b9c5-0e63e9b2f61b => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:36:11.083079 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-aabe34bb-5dbd-41bb-bb68-1128186894aa tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38d12a8b0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:11.841339 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-aabe34bb-5dbd-41bb-bb68-1128186894aa tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] HTTP exception thrown: Snapshot 92860164-6399-4930-ac4d-f2cf40698c8c could not be found. Mar 02 03:36:11.842058 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-aabe34bb-5dbd-41bb-bb68-1128186894aa tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Returning 404 to user: Snapshot 92860164-6399-4930-ac4d-f2cf40698c8c could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:11.842936 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-aabe34bb-5dbd-41bb-bb68-1128186894aa tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c" status: 404 len: 111 microversion: 2.1 time: 0.765141 Mar 02 03:36:11.843565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 27/43] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:36:11 2022] GET /compute/v2.1/os-snapshots/92860164-6399-4930-ac4d-f2cf40698c8c => generated 111 bytes in 766 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:36:11.852749 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-fb69f925-13b5-4f61-8671-90a1e54abcd0 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38c8ef4c0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:12.044790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:12.046140 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:12.059201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:12.059829 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:12.060887 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:12.061526 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:12.073697 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-fb69f925-13b5-4f61-8671-90a1e54abcd0 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0" status: 202 len: 0 microversion: 2.1 time: 0.225288 Mar 02 03:36:12.076215 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 17/44] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Mar 2 03:36:11 2022] DELETE /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:36:12.098675 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8088f7d6-2ffb-4c2a-854b-abbc2b63e75d tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38c93af70>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:12.244071 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8088f7d6-2ffb-4c2a-854b-abbc2b63e75d tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0" status: 200 len: 344 microversion: 2.1 time: 0.162611 Mar 02 03:36:12.245091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 18/45] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:12 2022] GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:12.252546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-383103313", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2b3d2cd-489e-4454-8144-25e2fab88e9d"}], "security_groups": [{"name": "tempest-securitygroup--2119051489"}], "key_name": "tempest-keypair-1678821105", "user_data": "}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:12.577700 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:12.629848 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-102b9261-9641-438f-a6ec-397afde10480 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1272 microversion: 2.1 time: 0.591832 Mar 02 03:36:12.630436 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 28/46] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:12 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1272 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:12.817594 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] validate_networks() for [('f2b3d2cd-489e-4454-8144-25e2fab88e9d', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:36:13.257074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3dc94bf6-f708-489d-8610-6e1392e7b849 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38d12a1f0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:13.542716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-3dc94bf6-f708-489d-8610-6e1392e7b849 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] HTTP exception thrown: Volume e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 could not be found. Mar 02 03:36:13.544544 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3dc94bf6-f708-489d-8610-6e1392e7b849 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Returning 404 to user: Volume e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:13.545261 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3dc94bf6-f708-489d-8610-6e1392e7b849 tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0" status: 404 len: 109 microversion: 2.1 time: 0.292202 Mar 02 03:36:13.546596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 29/47] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:13 2022] GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 => generated 109 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:36:13.567235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c082e66b-1cb7-4a0d-9f3e-f3ae656452ab tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38d1338b0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:13.624387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-c082e66b-1cb7-4a0d-9f3e-f3ae656452ab tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] HTTP exception thrown: Volume e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 could not be found. Mar 02 03:36:13.625175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c082e66b-1cb7-4a0d-9f3e-f3ae656452ab tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Returning 404 to user: Volume e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:13.626075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c082e66b-1cb7-4a0d-9f3e-f3ae656452ab tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0" status: 404 len: 109 microversion: 2.1 time: 0.065332 Mar 02 03:36:13.630639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 30/48] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Mar 2 03:36:13 2022] DELETE /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:36:13.636975 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-08f26adc-51b6-41ef-8e4a-51a26cdbec1d tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Calling method '.version_select at 0x7fc38d12a550>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:13.708388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-08f26adc-51b6-41ef-8e4a-51a26cdbec1d tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] HTTP exception thrown: Volume e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 could not be found. Mar 02 03:36:13.709265 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-08f26adc-51b6-41ef-8e4a-51a26cdbec1d tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] Returning 404 to user: Volume e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:36:13.711147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-08f26adc-51b6-41ef-8e4a-51a26cdbec1d tempest-VolumesSnapshotsTestJSON-1371163566 tempest-VolumesSnapshotsTestJSON-1371163566-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0" status: 404 len: 109 microversion: 2.1 time: 0.078817 Mar 02 03:36:13.715925 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 31/49] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:13 2022] GET /compute/v2.1/os-volumes/e2275bd2-4617-4a2a-bfc8-9fea2046bdb0 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:36:13.744044 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:13.751298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:13.779903 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:13.780493 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:13.781347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:13.781794 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:13.981242 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:13.988651 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3db1ac47-ec5e-44d4-b777-e201c3c654e7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1272 microversion: 2.1 time: 0.270121 Mar 02 03:36:14.001893 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 32/50] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:13 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:14.589591 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:36:14.593740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:36:14.594545 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:36:14.595248 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:36:14.595726 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:36:14.607306 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:14.608033 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:14.609154 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:14.609803 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:14.669433 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for project e7eaffa6e46a4505b1573a455ec97201. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:36:14.677104 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for user b101d4fa905743eb944d80e401ee5768 and project e7eaffa6e46a4505b1573a455ec97201. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:36:14.702256 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:36:14.704532 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:36:14.800419 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1b44ee01-2786-4430-82cf-33ff7eb56a48 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.553005 Mar 02 03:36:14.801042 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 19/51] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:36:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:36:14.814463 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e62d723d-6ef8-44a2-b8b2-dd7eb9efb53c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:14.817019 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e62d723d-6ef8-44a2-b8b2-dd7eb9efb53c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:14.989407 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e62d723d-6ef8-44a2-b8b2-dd7eb9efb53c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:14.999369 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e62d723d-6ef8-44a2-b8b2-dd7eb9efb53c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1237 microversion: 2.1 time: 0.191203 Mar 02 03:36:15.012202 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:15.013223 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:15.022271 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 33/52] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:14 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:15.024867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:15.025974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:15.029524 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:15.030130 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:15.275736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:15.286219 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c714a3b9-e4ad-4d89-bcba-15870cfb144e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.280765 Mar 02 03:36:15.287311 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 20/53] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:15 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:16.038911 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:16.041147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:16.051139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:16.051986 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:16.054025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:16.055261 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:16.163321 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:16.183370 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e304c079-df8e-4b83-9d8f-a03f193aad8b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1241 microversion: 2.1 time: 0.148221 Mar 02 03:36:16.188743 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 34/54] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:16 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:16.303765 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:16.305229 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:16.312908 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:16.313638 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:16.314840 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:16.315514 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:16.516617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:16.526481 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d06b1ac7-6aae-4bc8-a590-f80417af2ddb tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.226219 Mar 02 03:36:16.537075 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 21/55] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:16 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:17.201377 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:17.201988 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:17.208303 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:17.208798 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:17.209583 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:17.210016 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:17.277959 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:17.285387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9ffca27c-55ce-45f2-889f-8a5bd7d8a85e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1241 microversion: 2.1 time: 0.088200 Mar 02 03:36:17.285956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 35/56] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:17 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:17.544457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:17.545298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:17.556489 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:17.557265 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:17.558285 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:17.558829 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:17.783267 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:17.792059 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-90b91e38-f609-4b43-8477-c9398dbb373e tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.252253 Mar 02 03:36:17.800865 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 22/57] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:17 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:18.310812 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:18.314306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:18.336431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:18.339283 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:18.343261 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:18.344418 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:18.446667 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:18.454673 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c7e1ca53-f4d9-4492-a8d3-44e98bf3d257 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1241 microversion: 2.1 time: 0.154156 Mar 02 03:36:18.455744 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 36/58] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:18 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:18.810489 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:18.812048 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:18.818849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:18.820392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:18.822485 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:18.823815 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:19.165834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:19.174301 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e28714eb-c6ac-43f1-abe1-62131aaf7a7f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.367699 Mar 02 03:36:19.174918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 23/59] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:18 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:19.472172 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:19.473771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:19.480695 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:19.481585 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:19.482599 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:19.484281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:19.556852 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:19.564327 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d55f6da3-bfe7-4460-8ce7-434f6f7f65be tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1241 microversion: 2.1 time: 0.095947 Mar 02 03:36:19.564894 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 37/60] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:19 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:20.193215 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:20.193884 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:20.209735 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:20.210509 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:20.212623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:20.213261 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:20.409138 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:20.418101 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c1058aef-cf38-4730-91f7-4fba8ba3a1fd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.229453 Mar 02 03:36:20.419316 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 24/61] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:20 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:20.582263 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:20.583656 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:20.590977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:20.595096 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:20.596219 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:20.596679 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:20.671715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:20.684870 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bf194348-8b9a-4f87-aa2a-6c9666719c92 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1241 microversion: 2.1 time: 0.102413 Mar 02 03:36:20.685228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 38/62] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:20 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:21.435600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:21.436434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:21.446466 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:21.447197 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:21.448089 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:21.448801 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:21.608692 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:21.617163 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-102f7179-fc6b-4eb5-aa8e-acfd47203580 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.185659 Mar 02 03:36:21.630253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 25/63] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:21 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:21.703023 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:21.704236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:21.712053 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:21.712835 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:21.714227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:21.714979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:21.816619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:21.846721 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8421f2d9-6244-4843-bd8d-1237ecdb5b72 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1241 microversion: 2.1 time: 0.146980 Mar 02 03:36:21.848006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 39/64] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:21 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1241 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:22.636191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:22.636975 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:22.643615 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:22.644072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:22.644982 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:22.645424 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:22.778495 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:22.785880 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5c085a42-cba3-49f6-a408-308076e520d9 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.154665 Mar 02 03:36:22.786440 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 26/65] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:22 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:22.872994 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:22.873633 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:22.879692 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:22.880152 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:22.880943 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:22.881392 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:22.974482 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:22.982921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-59554cee-ccd7-4f24-93b9-c3c9253f784c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1241 microversion: 2.1 time: 0.114221 Mar 02 03:36:22.983538 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 40/66] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:22 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:23.804010 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:23.805200 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:23.811644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:23.812278 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:23.813751 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:23.814329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:24.001874 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:24.004565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:24.011184 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:24.012515 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:24.013855 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:24.014562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:24.132817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:24.143812 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d43ed19a-605b-41a0-929b-043d8ed9ff7a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1307 microversion: 2.1 time: 0.146619 Mar 02 03:36:24.146323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:24.146619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 41/67] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:23 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:24.157095 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-52fc6dc0-a8bc-4ee2-ac8f-54c4b0649f52 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.356951 Mar 02 03:36:24.157515 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 27/68] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:23 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:24.158165 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-24e380ce-e753-4422-ab8b-4a27c6cab0fd tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38d1330d0>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:24.251112 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-24e380ce-e753-4422-ab8b-4a27c6cab0fd tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eae1569e-4bb7-4d5e-b2be-d2b5b7e1e8ce" status: 200 len: 350 microversion: 2.1 time: 0.099857 Mar 02 03:36:24.257671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 42/69] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:24 2022] GET /compute/v2.1/os-volumes/eae1569e-4bb7-4d5e-b2be-d2b5b7e1e8ce => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:24.842019 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-b5caa1bc-63a2-44e1-9b82-cc14a866a8f0 req-7f02eda6-284a-4505-a0ab-16c30303cc83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0efbbf36-d2e9-4a65-b183-b42bcd3dfed3", "tag": "986e127d-0c43-4831-86d6-63ab8eed6000"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:24.861475 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-b5caa1bc-63a2-44e1-9b82-cc14a866a8f0 req-7f02eda6-284a-4505-a0ab-16c30303cc83 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:24.861928 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-b5caa1bc-63a2-44e1-9b82-cc14a866a8f0 req-7f02eda6-284a-4505-a0ab-16c30303cc83 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:24.890822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-b5caa1bc-63a2-44e1-9b82-cc14a866a8f0 req-7f02eda6-284a-4505-a0ab-16c30303cc83 service nova] Creating event network-changed:986e127d-0c43-4831-86d6-63ab8eed6000 for instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 on hv-cinder-83109 Mar 02 03:36:24.891517 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-b5caa1bc-63a2-44e1-9b82-cc14a866a8f0 req-7f02eda6-284a-4505-a0ab-16c30303cc83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 02 03:36:24.892695 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cc5edb5-e1d6-4c4f-91a7-a11ef41622d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:24.893329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cc5edb5-e1d6-4c4f-91a7-a11ef41622d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:24.894129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cc5edb5-e1d6-4c4f-91a7-a11ef41622d4 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:24.899752 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cc5edb5-e1d6-4c4f-91a7-a11ef41622d4 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:24.910323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.compute.rpcapi [None req-0cc5edb5-e1d6-4c4f-91a7-a11ef41622d4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 02 03:36:24.912054 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cc5edb5-e1d6-4c4f-91a7-a11ef41622d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 02 03:36:24.941788 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0cc5edb5-e1d6-4c4f-91a7-a11ef41622d4 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206779 Mar 02 03:36:24.942824 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 28/70] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:25.166403 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:25.167081 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:25.174821 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:25.175734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:25.188250 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:25.189250 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:25.190984 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:25.192918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:25.193238 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:25.193561 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:25.196992 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:25.197690 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:25.826042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:25.830016 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-cfdca266-8b1a-422d-b820-0f6e4f8d662d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.667788 Mar 02 03:36:25.834312 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 43/71] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:25 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:25.886686 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:25.889156 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-59b7ab26-d31e-4644-99f8-67d5ca269684 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38d960a60>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:25.895454 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a69d4bd7-0b4a-4187-9ef5-9ee17095b705 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.725220 Mar 02 03:36:25.899866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 29/72] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:25 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:26.037740 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-59b7ab26-d31e-4644-99f8-67d5ca269684 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/52040cc3-f78c-4a32-8be1-dad707484de4" status: 200 len: 351 microversion: 2.1 time: 0.157533 Mar 02 03:36:26.038401 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 44/73] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:25 2022] GET /compute/v2.1/os-volumes/52040cc3-f78c-4a32-8be1-dad707484de4 => generated 351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:26.715553 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-09541975-b9d2-4499-8d1e-b6a8c0b14aea req-843e615c-afa6-41f7-b970-7ae016ea9ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4602d0-7bdf-4d87-a748-e9b324e1a566", "tag": "10447e32-8d88-44df-9480-8b3b38b17f4e"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:26.724486 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-09541975-b9d2-4499-8d1e-b6a8c0b14aea req-843e615c-afa6-41f7-b970-7ae016ea9ae6 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:26.725312 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-09541975-b9d2-4499-8d1e-b6a8c0b14aea req-843e615c-afa6-41f7-b970-7ae016ea9ae6 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:26.741508 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-09541975-b9d2-4499-8d1e-b6a8c0b14aea req-843e615c-afa6-41f7-b970-7ae016ea9ae6 service nova] Creating event network-changed:10447e32-8d88-44df-9480-8b3b38b17f4e for instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 on hv-cinder-83109 Mar 02 03:36:26.746578 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-09541975-b9d2-4499-8d1e-b6a8c0b14aea req-843e615c-afa6-41f7-b970-7ae016ea9ae6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094736 Mar 02 03:36:26.747475 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 30/74] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:26.847915 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:26.849066 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:26.855108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:26.855574 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:26.856347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:26.856930 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:26.916948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:26.917669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:26.924198 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:26.924887 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:26.925830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:26.926278 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:27.061926 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:27.077758 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f27d7921-5551-4087-b56e-e90641791635 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.233577 Mar 02 03:36:27.078436 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 45/75] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:26 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:27.123412 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:27.130655 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-02123393-32fa-418f-bb57-71c29f4cd5cd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.218776 Mar 02 03:36:27.131243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 31/76] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:26 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:28.095440 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:28.096193 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:28.103124 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:28.103473 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:28.104371 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:28.104963 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:28.166006 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:28.166822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:28.173247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:28.173737 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:28.174587 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:28.175033 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:28.285315 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:28.292990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-81a02fde-6551-4b65-be8f-d3b9e055d8a4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.201407 Mar 02 03:36:28.293545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 46/77] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:28 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:28.366388 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:28.373675 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-95c37cb4-5a9d-4ad3-9611-80e90e63e5d2 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.228948 Mar 02 03:36:28.374463 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 32/78] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:28 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:29.317430 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:29.318046 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:29.326211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:29.329337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:29.330212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:29.332353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:29.390511 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:29.391686 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:29.399507 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:29.400092 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:29.400983 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:29.401740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:29.529914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:29.543218 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1382a574-2f92-472d-9e60-720ee2f41f95 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.229523 Mar 02 03:36:29.543797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 47/79] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:29 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:29.591909 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7f784b07-39b5-48b1-882f-afb601aa2100 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38d143e50>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:29.599658 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:29.608644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e733934b-bb77-47a2-8ecd-954a4a51ab32 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.221900 Mar 02 03:36:29.610008 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 33/80] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:29 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:29.646293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7f784b07-39b5-48b1-882f-afb601aa2100 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/87a43b35-f5f1-4478-b70e-306bd18d2bc1" status: 200 len: 351 microversion: 2.1 time: 0.058813 Mar 02 03:36:29.646864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 48/81] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Mar 2 03:36:29 2022] GET /compute/v2.1/os-volumes/87a43b35-f5f1-4478-b70e-306bd18d2bc1 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:36:29.658320 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-45e84720-5b28-4881-b973-69d80b873e02 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38c8efaf0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:29.739012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-45e84720-5b28-4881-b973-69d80b873e02 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084836 Mar 02 03:36:29.739579 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 34/82] 10.222.0.23 () {58 vars in 1133 bytes} [Wed Mar 2 03:36:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:29.752017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9c8a5bc1-3139-4da8-a251-b9c77068772d tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38dbe6820>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:29.837229 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9c8a5bc1-3139-4da8-a251-b9c77068772d tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088799 Mar 02 03:36:29.838223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 49/83] 10.222.0.23 () {58 vars in 1148 bytes} [Wed Mar 2 03:36:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:29.849641 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ffdb8605-01b3-4b83-b7ff-28fd98a39798 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38c90e160>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:29.940431 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ffdb8605-01b3-4b83-b7ff-28fd98a39798 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094515 Mar 02 03:36:29.941005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 35/84] 10.222.0.23 () {58 vars in 1133 bytes} [Wed Mar 2 03:36:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:29.952839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-32573af2-8ccd-44b8-b0c7-f8bdcbd8e91a tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38d133b80>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:30.173324 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-32573af2-8ccd-44b8-b0c7-f8bdcbd8e91a tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.224555 Mar 02 03:36:30.174140 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 50/85] 10.222.0.23 () {58 vars in 1166 bytes} [Wed Mar 2 03:36:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:30.186871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-69f4c941-0ff9-44e0-bc8f-27b4e0e33c94 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38c917d30>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:30.285534 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-69f4c941-0ff9-44e0-bc8f-27b4e0e33c94 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102325 Mar 02 03:36:30.286364 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 36/86] 10.222.0.23 () {58 vars in 1169 bytes} [Wed Mar 2 03:36:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:30.298954 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3ca0397b-3bb6-4b7d-a11d-c393278088eb tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38dbe6550>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:30.385418 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3ca0397b-3bb6-4b7d-a11d-c393278088eb tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090235 Mar 02 03:36:30.386319 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 51/87] 10.222.0.23 () {58 vars in 1154 bytes} [Wed Mar 2 03:36:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:30.397393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c5bf78b3-1b43-497b-ad39-d98563085d87 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38c8c5af0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:30.565530 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:30.566381 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:30.576232 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:30.577724 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:30.579764 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:30.581222 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:30.587252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c5bf78b3-1b43-497b-ad39-d98563085d87 tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.192764 Mar 02 03:36:30.595190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 37/88] 10.222.0.23 () {58 vars in 1187 bytes} [Wed Mar 2 03:36:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:30.600834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4e7025a3-833f-44d2-8825-c83fc0da93cd tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] Calling method '.version_select at 0x7fc38c8b6670>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:30.734591 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4e7025a3-833f-44d2-8825-c83fc0da93cd tempest-VolumesTestJSON-405002870 tempest-VolumesTestJSON-405002870-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.137664 Mar 02 03:36:30.735201 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 38/89] 10.222.0.23 () {58 vars in 1154 bytes} [Wed Mar 2 03:36:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:30.741334 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:30.743080 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:30.750309 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:30.751500 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:30.752626 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:30.753214 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:30.802559 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:30.811886 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2c447949-7588-4b3e-acca-9744b960e0aa tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.250869 Mar 02 03:36:30.812843 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 52/90] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:30 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:30.984124 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:30.992634 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6c2d185c-bca2-4f04-8a15-ac79ce378499 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.255743 Mar 02 03:36:31.001823 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 39/91] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:30 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:31.830512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:31.831297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:31.838112 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:31.839002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:31.839960 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:31.841295 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:32.009628 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:32.010255 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:32.017063 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:32.017519 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:32.018309 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:32.018740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:32.027788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:32.040107 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2b7d706c-d9f4-410c-a7e8-5dbf35e8d7fb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.211888 Mar 02 03:36:32.041351 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 53/92] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:31 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:32.221934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:32.231758 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a827645a-d554-4b67-b1f6-2461dd26fb43 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.226528 Mar 02 03:36:32.233809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 40/93] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:32 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:33.056809 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:33.057431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:33.063602 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:33.064046 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:33.064822 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:33.065254 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:33.253623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:33.257376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:33.272374 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:33.272496 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:33.273097 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:33.274914 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:33.275889 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:33.278299 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-51a37441-72ea-4e46-8df7-e9e106807562 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.226062 Mar 02 03:36:33.278902 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 54/94] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:33 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:33.474791 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:33.483745 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c02f1ebd-96aa-43ea-ad33-ac4b29a996ba tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.235837 Mar 02 03:36:33.484409 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 41/95] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:33 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:34.296267 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:34.297697 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:34.307919 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:34.308596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:34.309453 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:34.309971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:34.450282 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:34.457594 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-26a07a7e-c282-45ee-851d-c32bb53ddb9e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.165430 Mar 02 03:36:34.458162 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 55/96] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:34 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:34.501700 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:34.502322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:34.508635 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:34.509168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:34.510521 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:34.511312 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:34.694345 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:34.702504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5abf4838-2b0b-40ab-947d-3600d4340a18 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.205317 Mar 02 03:36:34.703247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 42/97] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:34 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:35.479572 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:35.481646 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:35.490819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:35.491633 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:35.498950 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:35.518430 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:35.721673 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:35.724042 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:35.725302 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:35.729622 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-25445296-67d6-4f96-a23e-78529bc11a9a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.256519 Mar 02 03:36:35.730712 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 56/98] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:35 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:35.734389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:35.734846 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:35.735656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:35.736303 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:35.914339 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:35.922527 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b4dc878e-476b-4eef-9212-28f589d638bd tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.202544 Mar 02 03:36:35.923593 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 43/99] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:35 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:36.747911 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:36.748907 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:36.772900 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:36.774362 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:36.776954 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:36.778952 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:36.939490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:36.940697 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:36.948081 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:36.948535 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:36.956022 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:36.959398 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:37.139619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:37.170542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d34991d7-7f56-4517-9272-09485a607ee4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.426678 Mar 02 03:36:37.173015 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 57/100] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:36 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:37.281112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:37.289449 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-67251f11-1428-407f-a877-709de3495b12 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.353593 Mar 02 03:36:37.304997 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 44/101] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:36 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:37.666144 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-3e57a143-bf64-4d56-a584-26fa3ff94b57 req-a9c1ab3a-1068-45c0-a23a-a82efbb6f502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0efbbf36-d2e9-4a65-b183-b42bcd3dfed3", "name": "network-vif-plugged", "status": "completed", "tag": "986e127d-0c43-4831-86d6-63ab8eed6000"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:37.677732 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-3e57a143-bf64-4d56-a584-26fa3ff94b57 req-a9c1ab3a-1068-45c0-a23a-a82efbb6f502 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:37.678328 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-3e57a143-bf64-4d56-a584-26fa3ff94b57 req-a9c1ab3a-1068-45c0-a23a-a82efbb6f502 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:37.701921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-3e57a143-bf64-4d56-a584-26fa3ff94b57 req-a9c1ab3a-1068-45c0-a23a-a82efbb6f502 service nova] Creating event network-vif-plugged:986e127d-0c43-4831-86d6-63ab8eed6000 for instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 on hv-cinder-83109 Mar 02 03:36:37.702535 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-3e57a143-bf64-4d56-a584-26fa3ff94b57 req-a9c1ab3a-1068-45c0-a23a-a82efbb6f502 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 02 03:36:37.703578 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a1ca7f-fd13-46dd-9034-b36bbeb979b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:37.704013 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a1ca7f-fd13-46dd-9034-b36bbeb979b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:37.704796 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a1ca7f-fd13-46dd-9034-b36bbeb979b6 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:37.705219 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a1ca7f-fd13-46dd-9034-b36bbeb979b6 None None] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:37.715701 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.compute.rpcapi [None req-81a1ca7f-fd13-46dd-9034-b36bbeb979b6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 02 03:36:37.716977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81a1ca7f-fd13-46dd-9034-b36bbeb979b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=123426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 02 03:36:37.738987 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-81a1ca7f-fd13-46dd-9034-b36bbeb979b6 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.562915 Mar 02 03:36:37.740119 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 58/102] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:38.187932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:38.189168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:38.196454 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:38.197569 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:38.199932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:38.200898 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:38.311437 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:38.312659 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:38.319096 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:38.319978 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:38.321652 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:38.322281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:38.362664 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:38.373702 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-aba68dfd-9f9c-4d4d-a25d-16c91629a499 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.189458 Mar 02 03:36:38.374317 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 45/103] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:38 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:38.480132 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:38.487770 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7b2c80cc-8279-4f35-a853-1606930a0719 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.181149 Mar 02 03:36:38.488272 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 59/104] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:38 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:39.389667 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:39.390273 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:39.396111 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:39.396562 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:39.397326 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:39.397761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:39.506737 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:39.508214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:39.516709 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:39.517270 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:39.518090 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:39.518470 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:39.533475 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:39.543179 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-eb12cee8-c273-4e50-a628-136e29c8657f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.157300 Mar 02 03:36:39.544762 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 46/105] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:39 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:39.650053 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:39.658304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1dca2af2-34f3-4314-930c-8172abd96740 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.156605 Mar 02 03:36:39.658864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 60/106] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:39 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:39.754082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-0af06a2f-891a-44ea-8750-2f7504d98f68 req-cb122a22-c170-4d7d-a713-53e88a9f252f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4602d0-7bdf-4d87-a748-e9b324e1a566", "name": "network-vif-plugged", "status": "completed", "tag": "10447e32-8d88-44df-9480-8b3b38b17f4e"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:39.762262 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-0af06a2f-891a-44ea-8750-2f7504d98f68 req-cb122a22-c170-4d7d-a713-53e88a9f252f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:39.762700 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-0af06a2f-891a-44ea-8750-2f7504d98f68 req-cb122a22-c170-4d7d-a713-53e88a9f252f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:39.773350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-0af06a2f-891a-44ea-8750-2f7504d98f68 req-cb122a22-c170-4d7d-a713-53e88a9f252f service nova] Creating event network-vif-plugged:10447e32-8d88-44df-9480-8b3b38b17f4e for instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 on hv-cinder-83109 Mar 02 03:36:39.779002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-0af06a2f-891a-44ea-8750-2f7504d98f68 req-cb122a22-c170-4d7d-a713-53e88a9f252f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028604 Mar 02 03:36:39.779616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 47/107] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:40.570777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:40.572326 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:40.580914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:40.581324 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:40.582488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:40.583082 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:40.676902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:40.677660 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:40.684877 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:40.685327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:40.686125 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:40.686577 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:40.739012 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:40.747818 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-18bddd5a-00e2-47a6-8302-81baa3b89da1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.187631 Mar 02 03:36:40.748387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 61/108] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:40 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:40.829652 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:40.837252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ea768b33-ae9b-475f-9aba-2f9cbc5e0ed4 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.164361 Mar 02 03:36:40.838282 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 48/109] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:40 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:36:41.765027 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:41.765642 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:41.772030 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:41.772724 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:41.773525 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:41.773967 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:41.857455 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:41.859546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:41.879462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:41.880077 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:41.881230 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:41.882007 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:41.936523 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:41.951002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-72903d15-bf3f-4f75-b50c-4d4d65b1ba28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.185137 Mar 02 03:36:41.952006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 62/110] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:41 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:42.111879 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:42.120483 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9e9650a2-03c7-4249-b7b7-eeece36d7727 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1314 microversion: 2.1 time: 0.270043 Mar 02 03:36:42.121241 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 49/111] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:41 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:42.970990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:42.971939 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:42.983460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:42.983922 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:42.984910 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:42.985521 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:43.138244 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:43.138943 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:43.146734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:43.148169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:43.151095 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:43.151529 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:43.171079 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:43.180785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-877d8906-8b04-4f42-80d9-9ba887c9b65a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1363 microversion: 2.1 time: 0.213481 Mar 02 03:36:43.183722 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 63/112] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:42 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:43.339069 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:43.346478 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d546c799-7477-40f9-b286-2e8ba0cd510d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1501 microversion: 2.1 time: 0.212154 Mar 02 03:36:43.347076 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 50/113] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:43 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:44.200672 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:44.201304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:44.207294 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:44.207748 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:44.208526 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:44.208960 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:44.349347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:36:44.357977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8459dd88-febe-45bf-9910-9ccc80094b28 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1549 microversion: 2.1 time: 0.161775 Mar 02 03:36:44.358623 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 64/114] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:36:44 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:36:44.375427 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bd637007-838f-4471-916a-d22ed68ba666 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:44.375920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bd637007-838f-4471-916a-d22ed68ba666 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:44.389366 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bd637007-838f-4471-916a-d22ed68ba666 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:44.391210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bd637007-838f-4471-916a-d22ed68ba666 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:44.392950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bd637007-838f-4471-916a-d22ed68ba666 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:44.393868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bd637007-838f-4471-916a-d22ed68ba666 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:44.528885 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bd637007-838f-4471-916a-d22ed68ba666 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157489 Mar 02 03:36:44.529577 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 51/115] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Mar 2 03:36:44 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:45.947568 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-672e4e00-6be6-4459-9510-415397e89972 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:36:45.948074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-672e4e00-6be6-4459-9510-415397e89972 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:45.951785 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-68f4c3b3-b2a2-45ea-bf73-2362e45fd44c req-73c599c3-4f08-430d-964b-c667f04ac4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4602d0-7bdf-4d87-a748-e9b324e1a566", "tag": "10447e32-8d88-44df-9480-8b3b38b17f4e"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:45.953875 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-672e4e00-6be6-4459-9510-415397e89972 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:45.954335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-672e4e00-6be6-4459-9510-415397e89972 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:45.955152 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-672e4e00-6be6-4459-9510-415397e89972 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:45.955594 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-672e4e00-6be6-4459-9510-415397e89972 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:45.966292 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-68f4c3b3-b2a2-45ea-bf73-2362e45fd44c req-73c599c3-4f08-430d-964b-c667f04ac4ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:45.966761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-68f4c3b3-b2a2-45ea-bf73-2362e45fd44c req-73c599c3-4f08-430d-964b-c667f04ac4ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:45.990973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-68f4c3b3-b2a2-45ea-bf73-2362e45fd44c req-73c599c3-4f08-430d-964b-c667f04ac4ee service nova] Creating event network-changed:10447e32-8d88-44df-9480-8b3b38b17f4e for instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 on hv-cinder-83109 Mar 02 03:36:45.999356 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-68f4c3b3-b2a2-45ea-bf73-2362e45fd44c req-73c599c3-4f08-430d-964b-c667f04ac4ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051113 Mar 02 03:36:46.003371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 52/116] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:46.019549 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-672e4e00-6be6-4459-9510-415397e89972 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/ips" status: 200 len: 106 microversion: 2.1 time: 0.076288 Mar 02 03:36:46.031252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 65/117] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Mar 2 03:36:45 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/ips => generated 106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:36:47.937159 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-09ce457b-e6e7-4a71-911e-a3782679c644 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32aacb18-3ab7-4137-be3d-38b859ab9ca7"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:36:47.938367 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-09ce457b-e6e7-4a71-911e-a3782679c644 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:36:47.945646 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09ce457b-e6e7-4a71-911e-a3782679c644 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:47.946172 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09ce457b-e6e7-4a71-911e-a3782679c644 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:47.947982 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09ce457b-e6e7-4a71-911e-a3782679c644 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:36:47.948575 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09ce457b-e6e7-4a71-911e-a3782679c644 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:36:48.311609 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-09ce457b-e6e7-4a71-911e-a3782679c644 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "POST /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378497 Mar 02 03:36:48.312243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 53/118] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:36:47 2022] POST /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:37:07.111272 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:07.111272 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:07.117249 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:07.117747 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:07.118574 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:07.119009 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:07.144238 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:37:07.260223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2439af9c-81c0-4108-8932-51507b49f93f tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 204 len: 0 microversion: 2.1 time: 0.153575 Mar 02 03:37:07.260949 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 66/119] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:37:07 2022] DELETE /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:37:07.270229 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:07.271016 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:07.278545 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:07.279150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:07.280210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:07.280714 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:07.565017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:07.573172 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-933c6b85-ddaa-4c85-9d41-541b5e81f1f7 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1553 microversion: 2.1 time: 0.307689 Mar 02 03:37:07.573728 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 54/120] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:07 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1553 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:08.590575 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:08.591335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:08.597213 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:08.597665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:08.598444 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:08.598881 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:08.752170 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:08.759952 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a806fe18-ec15-4bcf-9fca-5cc22b606571 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1553 microversion: 2.1 time: 0.173678 Mar 02 03:37:08.760521 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 67/121] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:08 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:09.777843 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:09.778674 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:09.785328 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:09.785846 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:09.786696 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:09.787309 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:09.923775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:09.932035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d11c92dc-f787-4e6a-84df-db0437b0d886 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1553 microversion: 2.1 time: 0.157643 Mar 02 03:37:09.932653 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 55/122] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:09 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:10.949626 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:10.950340 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:10.956274 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:10.957056 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:10.957843 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:10.958287 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:11.104209 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:11.116544 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-37a27306-5cc5-4366-9499-a419607e649c tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1553 microversion: 2.1 time: 0.171453 Mar 02 03:37:11.117132 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 68/123] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:10 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:12.133796 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:12.134416 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:12.151638 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:12.152200 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:12.163662 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:12.164494 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:12.434512 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:12.444777 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-49b85b90-415a-4820-ac21-45ba8f60f10d tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1553 microversion: 2.1 time: 0.314844 Mar 02 03:37:12.445620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 56/124] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:12 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1553 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:12.648326 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-6e236518-3ebc-4960-8f06-07ac88ed1241 req-a0a7819e-6880-4d85-99f6-b03cedf9eb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0efbbf36-d2e9-4a65-b183-b42bcd3dfed3", "name": "network-vif-deleted", "tag": "986e127d-0c43-4831-86d6-63ab8eed6000"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:12.657315 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-6e236518-3ebc-4960-8f06-07ac88ed1241 req-a0a7819e-6880-4d85-99f6-b03cedf9eb60 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:12.658092 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-6e236518-3ebc-4960-8f06-07ac88ed1241 req-a0a7819e-6880-4d85-99f6-b03cedf9eb60 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:12.674418 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-6e236518-3ebc-4960-8f06-07ac88ed1241 req-a0a7819e-6880-4d85-99f6-b03cedf9eb60 service nova] Creating event network-vif-deleted:986e127d-0c43-4831-86d6-63ab8eed6000 for instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 on hv-cinder-83109 Mar 02 03:37:12.684189 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-6e236518-3ebc-4960-8f06-07ac88ed1241 req-a0a7819e-6880-4d85-99f6-b03cedf9eb60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039433 Mar 02 03:37:12.684807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 69/125] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:37:13.462335 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:13.463779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:13.474270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:13.475117 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:13.476102 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:13.476741 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:13.533810 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:13.534527 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:13.535207 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lazy-loading 'fault' on Instance uuid 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:37:13.591929 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e231ec8b5b94979941284ffed81a2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c8fe4c2483453594312bc39df134c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:13.615811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-06d8d88d-acd3-43d4-979a-7df3ef5db031 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 200 len: 1350 microversion: 2.1 time: 0.157329 Mar 02 03:37:13.616613 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 57/126] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:13 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:14.636836 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:14.638522 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:14.646116 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:14.646751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:14.648281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:14.648281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:14.662762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] HTTP exception thrown: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. Mar 02 03:37:14.663386 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Returning 404 to user: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:37:14.664212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9e8e43c7-f220-4a7d-a7cc-29b6d1c90d69 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 404 len: 111 microversion: 2.1 time: 0.033841 Mar 02 03:37:14.665233 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 70/127] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:14 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:37:14.794387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:14.795760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:14.802849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:14.803324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:14.804686 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:14.805123 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:14.820412 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] HTTP exception thrown: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. Mar 02 03:37:14.821266 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Returning 404 to user: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:37:14.822415 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-deec440e-24db-4958-ba0e-271e38507e58 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033532 Mar 02 03:37:14.822980 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 58/128] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:37:14 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:37:16.125275 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:16.127926 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:16.145455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:16.145917 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:16.146788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:16.147216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:16.202630 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] HTTP exception thrown: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. Mar 02 03:37:16.203273 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Returning 404 to user: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:37:16.204394 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8214396b-8eec-48fd-870b-77e7827e8319 tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 404 len: 111 microversion: 2.1 time: 0.088622 Mar 02 03:37:16.207915 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 71/129] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:37:16 2022] DELETE /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:37:16.214966 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:16.216085 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] [instance: 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:16.223904 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:16.224570 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:16.225605 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:16.226238 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:16.254540 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] HTTP exception thrown: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. Mar 02 03:37:16.255181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] Returning 404 to user: Instance 0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:37:16.257098 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-37bc49ff-511e-47b1-9150-5b3da173a4ea tempest-DeleteServersTestJSON-2103161780 tempest-DeleteServersTestJSON-2103161780-project] 10.222.0.23 "GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3" status: 404 len: 111 microversion: 2.1 time: 0.047143 Mar 02 03:37:16.259757 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 59/130] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:16 2022] GET /compute/v2.1/servers/0efbbf36-d2e9-4a65-b183-b42bcd3dfed3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:37:24.479298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-378039294", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:24.561998 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] validate_networks() for [('4670bf1f-bec7-4596-ac96-b110fd818e8e', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:37:25.405198 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:37:25.406004 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:37:25.406773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:37:25.407243 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:37:25.408084 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:37:25.422337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:25.422977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:25.424318 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:25.424968 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:25.457558 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Getting quotas for project 71f89629bbd3430a8609e478eef5895b. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:37:25.463338 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Getting quotas for user fcf8e657ca8946a7afdd007c82eddebd and project 71f89629bbd3430a8609e478eef5895b. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:37:25.476891 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:37:25.480705 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:37:25.695972 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b200d634-d4a9-4eb2-a74f-4f1998e2eca1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.344573 Mar 02 03:37:25.697914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 72/131] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:37:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:37:25.708898 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e0374604-eaf1-47c7-8ef8-8f3949d62c86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:25.711182 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e0374604-eaf1-47c7-8ef8-8f3949d62c86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:25.789839 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e0374604-eaf1-47c7-8ef8-8f3949d62c86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:25.797987 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e0374604-eaf1-47c7-8ef8-8f3949d62c86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1221 microversion: 2.1 time: 0.094144 Mar 02 03:37:25.800014 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 60/132] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:25 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:37:25.971323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1881206290", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:26.068178 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] validate_networks() for [('4670bf1f-bec7-4596-ac96-b110fd818e8e', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:37:26.541473 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:37:26.542123 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:37:26.542578 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:37:26.543087 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:37:26.544059 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:37:26.570429 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:26.570889 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:26.571771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:26.572730 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:26.610773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Getting quotas for project 71f89629bbd3430a8609e478eef5895b. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:37:26.615860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Getting quotas for user fcf8e657ca8946a7afdd007c82eddebd and project 71f89629bbd3430a8609e478eef5895b. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:37:26.631842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:37:26.634201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:37:26.698450 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8258beda-5b80-4a70-90e3-8240ff2d3ccf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.731852 Mar 02 03:37:26.700307 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 73/133] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:37:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:37:26.711387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4dedd851-7c1b-42f4-88c2-d416ac73a49c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:26.714056 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4dedd851-7c1b-42f4-88c2-d416ac73a49c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:26.818979 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4dedd851-7c1b-42f4-88c2-d416ac73a49c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:26.829754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4dedd851-7c1b-42f4-88c2-d416ac73a49c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1222 microversion: 2.1 time: 0.123786 Mar 02 03:37:26.830908 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 61/134] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:26 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:37:27.851332 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:27.852568 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:27.862187 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:27.864060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:27.865134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:27.865741 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:27.946937 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:27.956303 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-35d65631-1551-4513-b682-274554de9624 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1274 microversion: 2.1 time: 0.111582 Mar 02 03:37:27.957271 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 74/135] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:27 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:28.974708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:28.977526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:28.987140 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:28.988024 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:28.989905 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:28.990830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:29.030705 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-7182d0dc-8e32-4196-b05c-b186e03108e3 req-77399326-9713-4bfa-8c23-9a1fe6c86fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a6146a9-fa07-430b-97f6-0e4174847543", "tag": "14e262d3-569e-4b08-8103-f41c4635b575"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:29.048350 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-7182d0dc-8e32-4196-b05c-b186e03108e3 req-77399326-9713-4bfa-8c23-9a1fe6c86fbe service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:29.048899 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-7182d0dc-8e32-4196-b05c-b186e03108e3 req-77399326-9713-4bfa-8c23-9a1fe6c86fbe service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:29.077302 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-7182d0dc-8e32-4196-b05c-b186e03108e3 req-77399326-9713-4bfa-8c23-9a1fe6c86fbe service nova] Creating event network-changed:14e262d3-569e-4b08-8103-f41c4635b575 for instance 3a6146a9-fa07-430b-97f6-0e4174847543 on hv-cinder-83109 Mar 02 03:37:29.085188 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-7182d0dc-8e32-4196-b05c-b186e03108e3 req-77399326-9713-4bfa-8c23-9a1fe6c86fbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062440 Mar 02 03:37:29.086284 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 75/136] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:37:29.257213 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:29.266089 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-59bbc2cc-4e6f-440e-bf62-26bd944b2a0e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.295902 Mar 02 03:37:29.266922 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 62/137] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:28 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:30.286040 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:30.286736 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:30.292824 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:30.293272 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:30.294042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:30.295180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:30.436498 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:30.443636 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-67fe2b86-ab3a-4a5a-a601-081387e08e22 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.161783 Mar 02 03:37:30.444192 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 76/138] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:30 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:31.460662 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:31.461265 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:31.468288 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:31.468993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:31.470125 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:31.470563 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:31.876140 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:31.885377 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9bff25d1-0f6f-450b-973c-b8fcdad0b590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.428820 Mar 02 03:37:31.886465 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 63/139] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:31 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:32.083603 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-4c6760f8-44c7-4e9b-b164-5cfd30157955 req-08863153-51bc-455e-af9d-7e8e75924694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1154afc0-676f-4f85-94fe-a605573997b5", "tag": "4adb2ae7-9d65-494f-ac1f-d825bc2a9d49"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:32.092958 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-4c6760f8-44c7-4e9b-b164-5cfd30157955 req-08863153-51bc-455e-af9d-7e8e75924694 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:32.093636 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-4c6760f8-44c7-4e9b-b164-5cfd30157955 req-08863153-51bc-455e-af9d-7e8e75924694 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:32.106286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-4c6760f8-44c7-4e9b-b164-5cfd30157955 req-08863153-51bc-455e-af9d-7e8e75924694 service nova] Creating event network-changed:4adb2ae7-9d65-494f-ac1f-d825bc2a9d49 for instance 1154afc0-676f-4f85-94fe-a605573997b5 on hv-cinder-83109 Mar 02 03:37:32.111410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-4c6760f8-44c7-4e9b-b164-5cfd30157955 req-08863153-51bc-455e-af9d-7e8e75924694 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031314 Mar 02 03:37:32.112002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 77/140] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:37:32.903957 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:32.904680 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:32.914699 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:32.919610 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:32.921532 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:32.922372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:33.119181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:33.127195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2c9cd40b-2bc3-405a-8bb2-54e6a76c4bf0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.228476 Mar 02 03:37:33.137377 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 64/141] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:32 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:34.145155 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:34.145764 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:34.152003 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:34.152455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:34.153234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:34.153673 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:34.291257 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:34.298442 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7f66e7a1-5694-459b-abd8-599f2c32f954 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.157587 Mar 02 03:37:34.299008 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 78/142] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:34 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:35.316130 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:35.316774 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:35.323411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:35.323862 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:35.324637 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:35.325068 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:35.456677 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:35.464107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e394bb93-391f-4952-9b2c-82658f97ae1f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.151795 Mar 02 03:37:35.464616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 65/143] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:35 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:36.480664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:36.481286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:36.487113 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:36.487576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:36.488369 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:36.488813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:36.627108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:36.635288 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-abcee117-f719-4d0c-a9b6-f8883d82c900 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.158386 Mar 02 03:37:36.635888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 79/144] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:36 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:37.651728 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:37.652338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:37.659322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:37.659778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:37.660563 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:37.661000 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:37.799883 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:37.807178 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c7c10bbd-94ff-46d1-b98e-466ee956db17 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.159182 Mar 02 03:37:37.807754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 66/145] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:37 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:38.325487 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-65a9011a-4065-4c20-9bc6-f6d1910fb9b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02f96d00-f25d-45a0-bfb8-b9c3eef03241"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:38.326934 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-65a9011a-4065-4c20-9bc6-f6d1910fb9b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:38.333275 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65a9011a-4065-4c20-9bc6-f6d1910fb9b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:38.334143 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65a9011a-4065-4c20-9bc6-f6d1910fb9b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:38.335299 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65a9011a-4065-4c20-9bc6-f6d1910fb9b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:38.335455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65a9011a-4065-4c20-9bc6-f6d1910fb9b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:38.682754 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-65a9011a-4065-4c20-9bc6-f6d1910fb9b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361094 Mar 02 03:37:38.683616 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 80/146] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:37:38 2022] POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:37:38.828748 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:38.830736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:38.838845 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:38.840600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:38.840600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:38.840790 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:38.970875 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-1e20bec5-86d0-4d43-887d-8ee6dcc7d710 req-f0960d33-ae4d-4c10-be07-811f68cfefb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1154afc0-676f-4f85-94fe-a605573997b5", "name": "network-vif-plugged", "status": "completed", "tag": "4adb2ae7-9d65-494f-ac1f-d825bc2a9d49"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:38.981084 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-1e20bec5-86d0-4d43-887d-8ee6dcc7d710 req-f0960d33-ae4d-4c10-be07-811f68cfefb4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:38.981584 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-1e20bec5-86d0-4d43-887d-8ee6dcc7d710 req-f0960d33-ae4d-4c10-be07-811f68cfefb4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:38.995317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-1e20bec5-86d0-4d43-887d-8ee6dcc7d710 req-f0960d33-ae4d-4c10-be07-811f68cfefb4 service nova] Creating event network-vif-plugged:4adb2ae7-9d65-494f-ac1f-d825bc2a9d49 for instance 1154afc0-676f-4f85-94fe-a605573997b5 on hv-cinder-83109 Mar 02 03:37:39.002689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-1e20bec5-86d0-4d43-887d-8ee6dcc7d710 req-f0960d33-ae4d-4c10-be07-811f68cfefb4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037274 Mar 02 03:37:39.003839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 81/147] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:37:39.009914 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:39.017614 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1f7db257-c5e7-4349-8f57-3aa08991e6a3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.195689 Mar 02 03:37:39.018185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 67/148] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:38 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:40.035258 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:40.036573 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:40.042529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:40.042984 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:40.044101 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:40.044536 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:40.263678 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:40.271988 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fc008e4e-f3dc-4b2a-9988-55c2ab5ee816 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1322 microversion: 2.1 time: 0.241696 Mar 02 03:37:40.272689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 82/149] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:40 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:41.023382 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-18f752cd-5e58-44b3-a1bd-0bd3e318bf63 req-74b55921-e0d2-44f2-87a4-d745bcb1ef15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6146a9-fa07-430b-97f6-0e4174847543", "name": "network-vif-plugged", "status": "completed", "tag": "14e262d3-569e-4b08-8103-f41c4635b575"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:41.031899 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-18f752cd-5e58-44b3-a1bd-0bd3e318bf63 req-74b55921-e0d2-44f2-87a4-d745bcb1ef15 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:41.032333 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-18f752cd-5e58-44b3-a1bd-0bd3e318bf63 req-74b55921-e0d2-44f2-87a4-d745bcb1ef15 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:41.043652 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-18f752cd-5e58-44b3-a1bd-0bd3e318bf63 req-74b55921-e0d2-44f2-87a4-d745bcb1ef15 service nova] Creating event network-vif-plugged:14e262d3-569e-4b08-8103-f41c4635b575 for instance 3a6146a9-fa07-430b-97f6-0e4174847543 on hv-cinder-83109 Mar 02 03:37:41.049818 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-18f752cd-5e58-44b3-a1bd-0bd3e318bf63 req-74b55921-e0d2-44f2-87a4-d745bcb1ef15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029677 Mar 02 03:37:41.050452 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 68/150] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:37:41.289782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:41.290543 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:41.297907 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:41.298360 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:41.299213 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:41.299649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:41.440979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:41.448207 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ba345216-20f8-46e1-9279-562265976b7a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1517 microversion: 2.1 time: 0.162388 Mar 02 03:37:41.448759 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 83/151] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:41 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:41.465833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:41.466841 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:41.472829 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:41.473275 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:41.474038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:41.474468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:41.497622 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lazy-loading 'flavor' on Instance uuid 1154afc0-676f-4f85-94fe-a605573997b5 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:37:41.608407 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-29707606-88d0-4f5c-9e1c-929ec23dadaf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5/action" status: 200 len: 32 microversion: 2.1 time: 0.147004 Mar 02 03:37:41.608929 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 69/152] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:37:41 2022] POST /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:37:41.618531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:41.619180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:41.625749 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:41.626375 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:41.627345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:41.627792 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:41.788853 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:41.799681 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2ee39a2b-76ea-4237-9f5a-fd1087fb7dc6 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.185312 Mar 02 03:37:41.811074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 84/153] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:41 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:42.825094 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:42.825800 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:42.832426 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:42.832912 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:42.833943 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:42.834378 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:42.985672 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:42.993751 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-db8be90d-f7a4-4b8e-964f-b17263389d36 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.174338 Mar 02 03:37:42.994861 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 70/154] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:42 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:44.012319 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:44.014268 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:44.033858 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:44.035304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:44.036373 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:44.044735 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:44.258006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:44.266871 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-eaf3a718-3548-48fc-895d-a0a8b3ff22f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.258848 Mar 02 03:37:44.267573 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 85/155] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:44 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:45.284292 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:45.285473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:45.292352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:45.292926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:45.293816 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:45.294775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:45.505832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:45.532797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-04bfe771-cda6-42ee-8e04-af2fc1849d7c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.249089 Mar 02 03:37:45.533715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 71/156] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:45 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:46.315521 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4bb001cc-7966-4ad8-a0ba-a2000c72007d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:37:46.329555 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4bb001cc-7966-4ad8-a0ba-a2000c72007d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:46.330339 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4bb001cc-7966-4ad8-a0ba-a2000c72007d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:46.409395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4bb001cc-7966-4ad8-a0ba-a2000c72007d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Going to try to stop instance {{(pid=123426) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 02 03:37:46.462579 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4bb001cc-7966-4ad8-a0ba-a2000c72007d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action" status: 202 len: 0 microversion: 2.1 time: 0.151178 Mar 02 03:37:46.463309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 86/157] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:37:46 2022] POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:37:46.475934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:46.477474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:46.487027 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:46.487710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:46.488613 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:46.489154 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:46.551106 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:46.552422 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:46.559421 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:46.560273 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:46.561254 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:46.561831 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:46.722468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:46.733958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-54e722f7-9671-4ba0-adf6-02e21eab330b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.264889 Mar 02 03:37:46.735567 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 72/158] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:46 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:46.832775 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:46.841134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-39f4eb4a-eeda-49e5-8c9e-71806d3a1e2b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.295038 Mar 02 03:37:46.841826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 87/159] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:46 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:47.757032 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:47.757671 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:47.770591 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:47.771801 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:47.772642 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:47.773150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:47.860226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:47.861099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:47.873069 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:47.873538 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:47.874345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:47.874788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:47.990871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:48.003826 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-afccdebd-ca57-499e-8d60-c1d4a685e28c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.250069 Mar 02 03:37:48.004725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 73/160] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:47 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:48.296876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:48.304436 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-59d08049-bd87-45bb-a53a-38b87382a5f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.450557 Mar 02 03:37:48.305056 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 88/161] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:47 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:49.022919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:49.023736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:49.031282 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:49.031816 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:49.032850 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:49.033286 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:49.185060 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:49.193564 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a12699b9-8e94-4a2c-afe0-0fe50db96a1e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.175679 Mar 02 03:37:49.194233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 74/162] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:49 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:49.321636 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:49.322248 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:49.329377 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:49.329828 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:49.330731 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:49.331217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:49.474017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:49.481563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-92237bc7-df47-4132-a0c8-ede700f99ab2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.163610 Mar 02 03:37:49.482087 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 89/163] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:49 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:50.211973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:50.213782 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:50.221471 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:50.222000 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:50.222849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:50.223669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:50.362766 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:50.373418 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e5d1a425-05aa-4858-ba4e-7c785e37d88c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.165675 Mar 02 03:37:50.374096 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 75/164] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:50 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:50.498025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:50.498639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:50.505354 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:50.505809 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:50.506591 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:50.507033 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:50.658267 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:50.666674 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-71766706-0ed3-4449-b5e6-c5d05966e7f7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.172810 Mar 02 03:37:50.667366 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 90/165] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:50 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:51.392473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:51.393200 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:51.399431 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:51.399912 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:51.400939 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:51.401394 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:51.552304 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:51.560911 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-33957a0b-c6a4-40ba-a80f-501fb0ec2d5c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.173802 Mar 02 03:37:51.561511 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 76/166] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:51 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:51.684679 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:51.685321 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:51.691817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:51.692266 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:51.693979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:51.693979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:51.843401 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:51.851246 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5bc20334-18f9-44c3-95b9-ef1241382dd4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.170639 Mar 02 03:37:51.852317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 91/167] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:51 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:52.578082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:52.578809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:52.585574 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:52.586047 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:52.586821 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:52.587285 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:52.720227 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:52.727969 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-56f80152-8c2d-4021-9521-5d1185ab01b2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.154273 Mar 02 03:37:52.728534 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 77/168] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:52 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:52.867931 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:52.868546 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:52.875554 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:52.876003 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:52.876833 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:52.877266 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:53.029802 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:53.039385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bc723e83-df97-483d-97c3-b88f16a0ae9f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.174917 Mar 02 03:37:53.040779 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 92/169] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:52 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:53.745886 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:53.748519 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:53.754056 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:53.754500 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:53.756027 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:53.756476 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:53.891380 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:53.899023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cc711a1c-8d1d-4baf-a208-59e187d59e15 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.157358 Mar 02 03:37:53.899632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 78/170] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:53 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:54.057296 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:54.057859 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:54.065094 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:54.065762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:54.066410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:54.066852 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:54.207308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:54.218172 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ea7d364f-697b-48c8-beef-60c881abcec3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.164238 Mar 02 03:37:54.219316 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 93/171] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:54 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:54.915675 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:54.916377 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:54.924895 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:54.925345 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:54.926130 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:54.926566 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:55.061053 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:55.069811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6e66617d-b5d9-430c-88ee-16d21d69e427 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.158165 Mar 02 03:37:55.070371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 79/172] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:54 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:55.235388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:55.236007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:55.242912 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:55.243404 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:55.244280 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:55.244764 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:55.381022 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:55.388678 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d3980b0a-2951-462e-8fc9-b5ec2fd28ea0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.157510 Mar 02 03:37:55.389435 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 94/173] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:55 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:56.087884 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:56.088672 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:56.095826 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:56.096270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:56.097052 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:56.097485 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:56.306210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:56.316293 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e216d53b-7b97-44ac-ab90-c60b4bf48a27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.232609 Mar 02 03:37:56.317001 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 80/174] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:56 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:56.408126 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:56.409061 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:56.415669 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:56.416331 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:56.417176 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:56.417745 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:56.587733 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:56.595664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-455c1058-ed6d-4977-a2bd-ca585ca45381 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.192706 Mar 02 03:37:56.596319 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 95/175] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:56 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:57.333501 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:57.334168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:57.341422 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:57.341936 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:57.342711 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:57.343176 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:57.491993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:57.499948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-08cc8238-1074-444f-ba16-cfa3f704eccd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.170682 Mar 02 03:37:57.500514 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 81/176] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:57 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:57.613206 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:57.613909 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:57.620580 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:57.621118 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:57.621983 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:57.622495 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:57.769804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:57.777084 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8d18d2fb-4e2d-4abb-bb62-04f762c5a414 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.167948 Mar 02 03:37:57.777656 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 96/177] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:57 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:58.518411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:58.519713 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:58.526861 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:58.527543 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:58.528498 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:58.529612 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:58.738051 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:58.749222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2a5704d1-8215-493e-bccf-fcf4aa89b926 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.235819 Mar 02 03:37:58.750582 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 82/178] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:58 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:58.793725 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:58.794378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:58.800759 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:58.801217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:58.802033 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:58.802466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:58.953297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:37:58.961744 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4b35e4a2-ba77-490c-9971-1505267262aa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.171820 Mar 02 03:37:58.972017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 97/179] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:58 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:37:59.769083 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:59.770239 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:59.776662 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:59.777190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:59.778151 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:59.778692 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:59.979706 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:37:59.980381 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:37:59.990117 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:59.990913 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:37:59.992121 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:37:59.992531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:00.014776 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:00.033758 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e7d89e4c-f7b2-47c7-ae98-6657d3a10b6f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.270325 Mar 02 03:38:00.034831 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 83/180] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:59 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:00.166638 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:00.176792 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6992523b-0246-4c04-b9eb-7bc6f9f5bff5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.201309 Mar 02 03:38:00.186805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 98/181] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:37:59 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:01.051707 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:01.052354 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:01.058769 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:01.059268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:01.060077 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:01.060511 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:01.193685 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:01.194295 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:01.198946 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:01.200900 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:01.201610 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:01.202758 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:01.203228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:01.207062 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7bf36fde-3570-4e6e-87cf-536c797ce1bd tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1724 microversion: 2.1 time: 0.159268 Mar 02 03:38:01.207910 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 84/182] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:01 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:01.338788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:01.347570 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2abcd51b-328e-4cfe-9c02-6a253306f3bf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.157744 Mar 02 03:38:01.348150 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 99/183] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:01 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:02.225808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:02.226648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:02.233959 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:02.234655 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:02.235542 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:02.235973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:02.364031 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:02.364654 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:02.368543 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:02.370662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:02.371148 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:02.371941 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:02.372444 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:02.377035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-143a64d7-da6e-4ff2-af1b-31474ea99db6 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1701 microversion: 2.1 time: 0.155423 Mar 02 03:38:02.377611 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 85/184] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:02 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:02.392946 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-38ca94a5-01c6-4f5f-8130-fc94741a839c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:02.398661 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-38ca94a5-01c6-4f5f-8130-fc94741a839c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:02.399142 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-38ca94a5-01c6-4f5f-8130-fc94741a839c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:02.460569 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-38ca94a5-01c6-4f5f-8130-fc94741a839c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Going to try to start instance {{(pid=123425) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 02 03:38:02.509708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-38ca94a5-01c6-4f5f-8130-fc94741a839c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action" status: 202 len: 0 microversion: 2.1 time: 0.120260 Mar 02 03:38:02.513480 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 86/185] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:38:02 2022] POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:38:02.513569 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:02.519711 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:02.520498 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:02.521090 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3312847a-552b-4a8c-8d52-23608c349be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.160982 Mar 02 03:38:02.527154 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:02.527632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:02.529084 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:02.529393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:02.531099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 100/186] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:02 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:02.670824 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:02.678943 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bfd688b2-df30-4d2c-ba35-5c12eca5ba2d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1710 microversion: 2.1 time: 0.164086 Mar 02 03:38:02.679919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 87/187] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:02 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:03.539989 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:03.540543 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:03.550260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:03.550920 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:03.552151 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:03.552650 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:03.697214 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:03.697827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:03.704744 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:03.705189 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:03.705969 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:03.706399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:03.707139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:03.715822 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-038af211-5f40-4e4d-9609-0a611c17a8f4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.180008 Mar 02 03:38:03.716829 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 101/188] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:03 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:03.849779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:03.858113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-be2bc32f-bc09-47fe-9f07-6954695e3065 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1710 microversion: 2.1 time: 0.165312 Mar 02 03:38:03.858685 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 88/189] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:03 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:03.987043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1203413811", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "0d399a0a-ad54-4ab5-920e-fb92454143ae"}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:04.048328 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] validate_networks() for [('0d399a0a-ad54-4ab5-920e-fb92454143ae', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:38:04.396545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:38:04.396968 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:38:04.397466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:38:04.397873 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:38:04.398281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:38:04.407489 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:04.407935 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:04.408737 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:04.409178 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:04.425144 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Getting quotas for project 81dac378b4f74c5d972b52cde9208383. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:38:04.429012 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Getting quotas for user 875e1eaabbfa482b8897bca1ce980893 and project 81dac378b4f74c5d972b52cde9208383. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:38:04.439895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:38:04.442104 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:38:04.488256 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e2dd9bef-ea42-4586-8574-f290faee3844 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505867 Mar 02 03:38:04.488898 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 102/190] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:38:04.498794 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5f813a83-590b-4a4b-b1ba-e583c78ed386 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:04.499429 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5f813a83-590b-4a4b-b1ba-e583c78ed386 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:04.553718 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5f813a83-590b-4a4b-b1ba-e583c78ed386 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:04.560774 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5f813a83-590b-4a4b-b1ba-e583c78ed386 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1219 microversion: 2.1 time: 0.065939 Mar 02 03:38:04.561646 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 89/191] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:04 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:04.735822 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:04.737219 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:04.746297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:04.746910 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:04.752757 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:04.753342 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:04.875647 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:04.876253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:04.885361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:04.889980 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:04.890968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:04.891560 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:04.945270 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:04.953302 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8e6604e1-506b-4288-94e1-7f83a446dd20 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.223546 Mar 02 03:38:04.953890 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 103/192] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:04 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:05.060262 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:05.081569 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ea7fe808-9d0f-4c47-90ba-53356da9f596 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1714 microversion: 2.1 time: 0.210335 Mar 02 03:38:05.091714 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 90/193] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:04 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1714 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:05.578594 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:05.579358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:05.585481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:05.585934 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:05.586705 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:05.587168 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:05.647465 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:05.655460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f498a9a6-7a60-4be4-bc96-a88d0c530eb1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1271 microversion: 2.1 time: 0.081498 Mar 02 03:38:05.656217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 104/194] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:05 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:05.970457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:05.971095 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:05.977179 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:05.977630 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:05.978419 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:05.978849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:06.120038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:06.130987 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e0cf02b2-3c8a-40e9-a188-aa87ee0eedc7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.165109 Mar 02 03:38:06.142129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 91/195] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:05 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:06.673832 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:06.673832 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:06.679680 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:06.680126 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:06.680907 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:06.681341 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:06.906661 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:06.927390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-64cfb650-e162-4aec-b6a6-46ae80279c87 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1319 microversion: 2.1 time: 0.257830 Mar 02 03:38:06.943294 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 105/196] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:06 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:07.152537 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:07.155351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:07.162842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:07.163459 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:07.164217 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:07.164654 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:07.168145 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-2e453dc0-c984-49ed-9462-d24792b53d8a req-4be8435a-8b2d-496f-a574-a51d076f69f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26b6d33-e3a8-4711-943e-240415615b75", "tag": "9904e835-5866-4716-970a-00e8b74ac7f0"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:07.183743 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-2e453dc0-c984-49ed-9462-d24792b53d8a req-4be8435a-8b2d-496f-a574-a51d076f69f1 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:07.184193 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-2e453dc0-c984-49ed-9462-d24792b53d8a req-4be8435a-8b2d-496f-a574-a51d076f69f1 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:07.202801 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-2e453dc0-c984-49ed-9462-d24792b53d8a req-4be8435a-8b2d-496f-a574-a51d076f69f1 service nova] Creating event network-changed:9904e835-5866-4716-970a-00e8b74ac7f0 for instance e26b6d33-e3a8-4711-943e-240415615b75 on hv-cinder-83109 Mar 02 03:38:07.213831 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-2e453dc0-c984-49ed-9462-d24792b53d8a req-4be8435a-8b2d-496f-a574-a51d076f69f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044728 Mar 02 03:38:07.214831 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 106/197] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:38:07.354728 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:07.363503 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-63880a5a-59a9-4b70-83e0-218fdec4d8d4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.219395 Mar 02 03:38:07.364291 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 92/198] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:07 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:07.947915 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:07.955269 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:07.962227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:07.962682 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:07.963518 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:07.963962 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:08.236845 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:08.244375 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7f4b9370-0b63-41c9-a8b1-2f56b838b07a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1319 microversion: 2.1 time: 0.301550 Mar 02 03:38:08.248449 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 107/199] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:07 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:08.381966 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:08.382696 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:08.389395 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:08.389838 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:08.390666 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:08.391116 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:08.529862 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:08.537090 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-34cd5294-ff20-4878-8eb0-590ddc8e52de tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.159604 Mar 02 03:38:08.537658 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 93/200] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:08 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:09.264562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:09.265711 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:09.271948 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:09.272402 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:09.273389 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:09.273830 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:09.420718 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:09.428123 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d24ef541-8f37-45c3-958e-b135667cb266 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1319 microversion: 2.1 time: 0.167681 Mar 02 03:38:09.428694 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 108/201] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:09 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:09.553611 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:09.554329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:09.561287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:09.561744 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:09.562526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:09.562962 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:09.703953 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:09.711880 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2c9b11c1-3b5a-473c-8a4e-ea405eb7be71 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.162105 Mar 02 03:38:09.712482 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 94/202] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:09 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:10.445954 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:10.446555 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:10.454020 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:10.454672 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:10.455750 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:10.456186 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:10.704664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:10.729654 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b3491433-d8ee-402b-8064-8eb0ca232194 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1319 microversion: 2.1 time: 0.287804 Mar 02 03:38:10.730123 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:10.730738 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:10.732819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 109/203] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:10 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:10.772874 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:10.773339 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:10.774137 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:10.774567 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:10.982330 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:10.994030 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-012bfebf-1c90-47b8-962d-a7339c75d45b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.269706 Mar 02 03:38:10.995601 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 95/204] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:10 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:11.750017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:11.750647 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:11.758438 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:11.758890 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:11.760256 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:11.760256 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:11.920584 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:11.929993 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f58955d3-228b-48df-9aa6-cee733d52475 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1319 microversion: 2.1 time: 0.184691 Mar 02 03:38:11.931279 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 110/205] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:11 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:12.013544 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:12.014851 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:12.024452 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:12.024901 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:12.027751 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:12.029002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:12.250360 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:12.259162 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ff8c1120-70f9-4910-a989-0cc7bb4c2abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.250762 Mar 02 03:38:12.271035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 96/206] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:12 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:12.929081 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-98883f54-2adc-4533-b863-18a62e4a5aac req-5c3c3d93-45a0-43d5-936d-73c8a47941ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26b6d33-e3a8-4711-943e-240415615b75", "name": "network-vif-plugged", "status": "completed", "tag": "9904e835-5866-4716-970a-00e8b74ac7f0"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:12.946439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-98883f54-2adc-4533-b863-18a62e4a5aac req-5c3c3d93-45a0-43d5-936d-73c8a47941ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:12.946898 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-98883f54-2adc-4533-b863-18a62e4a5aac req-5c3c3d93-45a0-43d5-936d-73c8a47941ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:12.948553 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:12.949253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:12.961038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:12.961528 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:12.962343 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:12.967945 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:12.978646 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-98883f54-2adc-4533-b863-18a62e4a5aac req-5c3c3d93-45a0-43d5-936d-73c8a47941ee service nova] Creating event network-vif-plugged:9904e835-5866-4716-970a-00e8b74ac7f0 for instance e26b6d33-e3a8-4711-943e-240415615b75 on hv-cinder-83109 Mar 02 03:38:12.984300 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-98883f54-2adc-4533-b863-18a62e4a5aac req-5c3c3d93-45a0-43d5-936d-73c8a47941ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059973 Mar 02 03:38:12.985119 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 111/207] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:38:13.277135 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:13.278258 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:13.287560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:13.289296 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:13.291854 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:13.294441 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:13.297474 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:13.301489 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-62f6027a-b798-47a2-bb99-68d4ec5243e4 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1319 microversion: 2.1 time: 0.358030 Mar 02 03:38:13.311203 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 97/208] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:12 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:13.608254 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:13.617096 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9ac3af44-0ce7-4e42-bd40-3a6568855590 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.344842 Mar 02 03:38:13.618228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 112/209] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:13 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:14.321165 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:14.322371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:14.339449 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:14.340916 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:14.342205 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:14.343085 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:14.535424 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:14.544208 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c42629d4-ec44-4107-bdf3-3ba8e130a75c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1319 microversion: 2.1 time: 0.226706 Mar 02 03:38:14.545298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 98/210] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:14 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:14.637226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:14.638651 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:14.645435 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:14.646258 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:14.647932 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:14.648574 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:14.811901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:14.820481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-cce73b40-703d-4b8c-9cb9-d63be6784cea tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.186699 Mar 02 03:38:14.831491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 113/211] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:14 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:15.562767 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:15.563409 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:15.571193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:15.572126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:15.572340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:15.572778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:15.838709 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:15.839458 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:15.853765 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:15.855139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:15.857226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:15.864782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:15.946647 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:15.962399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a662babc-e1ed-4efa-8d7b-694423cac31a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1509 microversion: 2.1 time: 0.404266 Mar 02 03:38:15.977891 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 99/212] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:15 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1509 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:16.194616 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:16.203897 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9b57b1a1-d6ff-4fa9-91a4-db27dbcaff8e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.369550 Mar 02 03:38:16.205895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 114/213] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:15 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:17.223884 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:17.233784 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:17.245144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:17.245593 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:17.247482 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:17.247926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:17.607117 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:17.618992 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-71172c95-d1f8-4a9b-ae16-3ef022d034ee tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1523 microversion: 2.1 time: 0.400398 Mar 02 03:38:17.626817 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 100/214] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:17 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:18.641604 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:18.642999 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:18.650902 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:18.651799 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:18.653231 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:18.653952 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:18.835184 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:18.849122 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ca380f4b-10f5-4bd2-bd20-b8082e1be80b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1503 microversion: 2.1 time: 0.214883 Mar 02 03:38:18.864223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 115/215] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:18 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:18.869453 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:18.870245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:18.877292 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:18.877968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:18.878931 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:18.879546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:19.063531 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:19.074437 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3d08a1df-dc4b-4c19-9e76-05098841e3e0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1515 microversion: 2.1 time: 0.208010 Mar 02 03:38:19.077076 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 101/216] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:18 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:20.633317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:20.635169 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:20.647074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:20.647978 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:20.649364 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:20.650120 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:20.700646 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lazy-loading 'flavor' on Instance uuid 3a6146a9-fa07-430b-97f6-0e4174847543 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:38:20.895138 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-45cf0ee8-b352-48b5-9bce-c3b0a7f4b565 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action" status: 200 len: 32 microversion: 2.1 time: 0.267933 Mar 02 03:38:20.900978 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 116/217] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:38:20 2022] POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:38:20.905354 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:20.906264 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:20.917788 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:20.920801 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:20.921832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:20.922433 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:21.816855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:21.826238 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-66efd373-41bb-4d68-b1fd-bfe2c9d103f1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.924747 Mar 02 03:38:21.839883 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 102/218] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:20 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:22.866280 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:22.869149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:22.890771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:22.892374 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:22.895464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:22.896358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:23.253373 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:23.260886 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-db850e09-e5ba-4fe2-826d-786a47024785 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.406655 Mar 02 03:38:23.271540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 117/219] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:22 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:24.279939 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:24.281134 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:24.291737 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:24.292225 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:24.293782 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:24.294294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:24.677396 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:24.689700 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ee53f6c2-80be-4a40-8ea2-bdde91906839 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.414299 Mar 02 03:38:24.699761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 103/220] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:24 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:25.233934 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-48b8eef8-dad8-4399-ba47-cf898edbef1c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Action: 'create', calling method: .version_select at 0x7fc37ff3bb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-546407427"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:25.257813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-48b8eef8-dad8-4399-ba47-cf898edbef1c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Getting quotas for project f70b0094f5e240b28b83102b4bab82cf. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:38:25.271010 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-48b8eef8-dad8-4399-ba47-cf898edbef1c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Getting quotas for user 9ebebe6f704f4102a9560210b1d5e0ec and project f70b0094f5e240b28b83102b4bab82cf. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:38:25.554924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-48b8eef8-dad8-4399-ba47-cf898edbef1c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Getting quotas for project f70b0094f5e240b28b83102b4bab82cf. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:38:25.559398 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-48b8eef8-dad8-4399-ba47-cf898edbef1c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Getting quotas for user 9ebebe6f704f4102a9560210b1d5e0ec and project f70b0094f5e240b28b83102b4bab82cf. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:38:25.583239 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-48b8eef8-dad8-4399-ba47-cf898edbef1c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.684031 Mar 02 03:38:25.584305 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 118/221] 10.222.0.23 () {60 vars in 1157 bytes} [Wed Mar 2 03:38:24 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:25.706458 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:25.707352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:25.719112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:25.719580 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:25.720437 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:25.720787 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:25.941361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:25.951544 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b180f8bb-a712-48f3-b572-51a607b11b24 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.249403 Mar 02 03:38:25.967244 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 104/222] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:25 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:26.970361 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:26.971864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:26.993684 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:26.997857 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:27.003028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:27.019876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:27.692378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:27.706357 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-314b70ae-7dca-4a9f-8365-eef6f4d8ad32 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.741033 Mar 02 03:38:27.711976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 119/223] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:26 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:28.730503 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:28.731694 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:28.738510 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:28.739476 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:28.740622 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:28.741349 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:28.920857 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:28.929223 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-56f263f9-e27f-4431-b604-f70bf2860397 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.203141 Mar 02 03:38:28.934527 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 105/224] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:28 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:29.956000 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:29.956875 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:29.963434 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:29.964092 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:29.966217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:29.966842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:30.139499 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:30.147763 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3f65d0e0-42f0-44a9-8488-b325af419ef7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.199306 Mar 02 03:38:30.148666 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 120/225] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:29 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:31.165310 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:31.166143 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:31.173715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:31.174306 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:31.175434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:31.175974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:31.341202 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:31.349496 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-367a7db0-2932-4ae4-8ca5-79142c2687cf tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.188692 Mar 02 03:38:31.350489 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 106/226] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:31 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:32.367908 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:32.370113 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:32.378074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:32.378776 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:32.379782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:32.380530 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:32.633056 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:32.641388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bbcebb26-dc3f-4930-b7f6-181bab831b86 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.278089 Mar 02 03:38:32.653716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 121/227] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:32 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:33.660044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:33.660669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:33.671187 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:33.675422 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:33.676469 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:33.677781 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:33.914297 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:33.922939 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5f242af4-0619-4220-a586-150196951ebd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.267310 Mar 02 03:38:33.934623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 107/228] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:33 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:34.940830 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:34.942047 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:34.959826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:34.960292 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:34.961102 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:34.961715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:35.165117 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:35.202495 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bd87549a-fe96-4b8d-b520-58dcd5f5f179 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.265007 Mar 02 03:38:35.208888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 122/229] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:34 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:36.148126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6f0032dd-740b-4c19-88c7-1ab93b1a382b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f754b009-8429-4a0b-8084-f899d5e4e4f1", "device": "/dev/sdb"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:36.150715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6f0032dd-740b-4c19-88c7-1ab93b1a382b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:36.159900 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f0032dd-740b-4c19-88c7-1ab93b1a382b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:36.161088 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f0032dd-740b-4c19-88c7-1ab93b1a382b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:36.162046 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f0032dd-740b-4c19-88c7-1ab93b1a382b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:36.162641 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f0032dd-740b-4c19-88c7-1ab93b1a382b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:36.235304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:36.239615 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:36.254846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:36.255507 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:36.257470 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:36.257917 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:36.521206 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:36.534304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-71495020-b896-4225-8f2b-8c9b2a1ebaf7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.315982 Mar 02 03:38:36.546278 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 123/230] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:36 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:36.581600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6f0032dd-740b-4c19-88c7-1ab93b1a382b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "POST /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438871 Mar 02 03:38:36.582689 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 108/231] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:38:36 2022] POST /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:38:37.552619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:37.553935 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:37.563563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:37.564726 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:37.566509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:37.569201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:37.841528 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:37.850481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-662eb682-65e3-4005-b7ce-37e45b13f421 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.301906 Mar 02 03:38:37.851794 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 124/232] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:37 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:38.869333 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:38.871521 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:38.877958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:38.878503 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:38.879399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:38.880061 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:39.038715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:39.049121 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-96243fc0-5a04-49d3-8d4b-c79f6f674e82 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.184064 Mar 02 03:38:39.050082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 109/233] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:38 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:40.070343 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:40.072739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:40.085479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:40.086141 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:40.087310 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:40.088297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:40.300257 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:40.310091 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e64975d2-e823-451e-ab9b-7365247221fe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.243997 Mar 02 03:38:40.311089 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 125/234] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:40 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:41.350789 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:41.352116 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:41.359235 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:41.359683 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:41.360466 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:41.360901 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:41.546156 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:41.554206 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dd75a7a8-18c3-4cf9-b9d3-49a5530f02d0 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.229352 Mar 02 03:38:41.555017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 110/235] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:41 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:42.573969 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:42.573969 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:42.588218 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:42.588691 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:42.591901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:42.592627 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:42.790439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:42.800270 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-145a161f-536b-46ed-85e8-61470ecbfab4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.230564 Mar 02 03:38:42.801352 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 126/236] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:42 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:43.817989 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:43.819320 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:43.831596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:43.832249 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:43.833224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:43.833663 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:44.016969 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:44.025433 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8232a62b-21f4-4b7d-b54b-863a433e7e1a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.211554 Mar 02 03:38:44.026902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 111/237] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:43 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:45.043781 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:45.044421 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:45.050589 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.051258 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.052266 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.052924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.208691 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:45.217415 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f38d6dd1-ec90-41bd-ab5d-206ec15ea9ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1501 microversion: 2.1 time: 0.177963 Mar 02 03:38:45.231540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 127/238] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:45 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:45.253504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07390778-8f9b-4ba6-951d-d9c97e2c0621"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:45.254623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:45.263417 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.264118 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.265570 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.266167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.296606 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] HTTP exception thrown: Cannot 'attach_volume' instance 3a6146a9-fa07-430b-97f6-0e4174847543 while it is in vm_state rescued Mar 02 03:38:45.297193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Returning 409 to user: Cannot 'attach_volume' instance 3a6146a9-fa07-430b-97f6-0e4174847543 while it is in vm_state rescued {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:38:45.298029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2e6f28e0-0616-4ddb-8c3a-e9588b0bf447 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051582 Mar 02 03:38:45.298581 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 112/239] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:38:45 2022] POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 02 03:38:45.308331 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-81baf385-6106-4988-a92f-0292f7927141 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:45.309108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-81baf385-6106-4988-a92f-0292f7927141 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:45.319335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81baf385-6106-4988-a92f-0292f7927141 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.320062 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81baf385-6106-4988-a92f-0292f7927141 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.321046 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81baf385-6106-4988-a92f-0292f7927141 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.321664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81baf385-6106-4988-a92f-0292f7927141 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.424454 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-81baf385-6106-4988-a92f-0292f7927141 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action" status: 202 len: 0 microversion: 2.1 time: 0.120809 Mar 02 03:38:45.425539 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 128/240] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:38:45 2022] POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:38:45.433825 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:45.434871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:45.442109 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.442622 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.443407 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:45.444032 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:45.780794 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:45.790739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-39ddf5be-73cb-4453-a430-52f8f506547a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.360567 Mar 02 03:38:45.796431 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 113/241] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:45 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:46.302228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-399ff3d8-ba18-47cb-818a-377b25c53615 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Action: 'create', calling method: .version_select at 0x7fc37feafaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-316284167"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:46.316663 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-399ff3d8-ba18-47cb-818a-377b25c53615 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Getting quotas for project 7e6b3df4db8641899040ec5bed522a1f. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:38:46.320340 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-399ff3d8-ba18-47cb-818a-377b25c53615 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Getting quotas for user 71d2173e1b7745df833fcabcb4d5ee99 and project 7e6b3df4db8641899040ec5bed522a1f. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:38:46.690109 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-399ff3d8-ba18-47cb-818a-377b25c53615 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Getting quotas for project 7e6b3df4db8641899040ec5bed522a1f. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:38:46.694103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-399ff3d8-ba18-47cb-818a-377b25c53615 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Getting quotas for user 71d2173e1b7745df833fcabcb4d5ee99 and project 7e6b3df4db8641899040ec5bed522a1f. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:38:46.709241 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-399ff3d8-ba18-47cb-818a-377b25c53615 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.411648 Mar 02 03:38:46.710042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 129/242] 10.222.0.23 () {60 vars in 1157 bytes} [Wed Mar 2 03:38:46 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:46.759589 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-235611541", "imageRef": "37ac244e-bd94-4ff0-b799-08fea278c3af", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-316284167", "networks": [{"uuid": "d23da59c-dbb0-4fd7-ab46-13b67d8570e6"}]}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:46.808808 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:46.809493 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:46.809931 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] validate_networks() for [('d23da59c-dbb0-4fd7-ab46-13b67d8570e6', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:38:46.815615 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:46.816074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:46.816865 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:46.817311 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:47.045686 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:47.052839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-29451c0b-0c9a-4be3-957d-f61788b23be5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.248590 Mar 02 03:38:47.053406 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 130/243] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:46 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:47.246985 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:38:47.247434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:38:47.247899 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:38:47.248298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:38:47.248698 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:38:47.257157 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:47.257595 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:47.258389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:47.258814 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:47.274366 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Getting quotas for project 7e6b3df4db8641899040ec5bed522a1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:38:47.278230 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Getting quotas for user 71d2173e1b7745df833fcabcb4d5ee99 and project 7e6b3df4db8641899040ec5bed522a1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:38:47.288855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:38:47.291044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37ac244e-bd94-4ff0-b799-08fea278c3af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:38:47.336683 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-40fdac63-57bc-4e94-a9bd-6f97039b9cd6 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580805 Mar 02 03:38:47.337554 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 114/244] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:38:47.347763 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ac8d4568-7d18-4f54-94f5-c9868e36dee2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:47.349047 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ac8d4568-7d18-4f54-94f5-c9868e36dee2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:47.407674 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ac8d4568-7d18-4f54-94f5-c9868e36dee2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:47.413236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ac8d4568-7d18-4f54-94f5-c9868e36dee2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1257 microversion: 2.1 time: 0.069830 Mar 02 03:38:47.413846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 131/245] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:47 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:48.071358 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:48.071970 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:48.078499 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:48.078947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:48.079746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:48.080182 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:48.214762 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:48.221941 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-28d169c3-7839-40f9-b1b6-d721755bfd7b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.155127 Mar 02 03:38:48.222500 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 115/246] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:48 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:48.430976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:48.431614 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:48.438602 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:48.439060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:48.439845 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:48.440286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:48.497311 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:48.504359 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-367e64de-beca-4f69-9f3f-a4a14913e380 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1261 microversion: 2.1 time: 0.077310 Mar 02 03:38:48.504921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 132/247] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:48 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:49.239366 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:49.239993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:49.246984 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:49.247479 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:49.248272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:49.248710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:49.390167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:49.397986 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-441cf489-a727-46be-a66d-6efb84302c80 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.162483 Mar 02 03:38:49.398675 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 116/248] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:49 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:49.521612 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:49.522234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:49.529982 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:49.530439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:49.531259 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:49.531700 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:49.592394 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:49.599636 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-db439ceb-933c-4b75-9930-bf1e3137deff tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1309 microversion: 2.1 time: 0.081975 Mar 02 03:38:49.600199 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 133/249] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:49 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:50.417115 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:50.417977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:50.424754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:50.424979 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:50.426062 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:50.426503 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:50.617802 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:50.618476 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:50.626808 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:50.627431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:50.628298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:50.628804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:50.840243 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:50.847843 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-842405a4-b2e8-44eb-99ab-06adac56571b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1315 microversion: 2.1 time: 0.234442 Mar 02 03:38:50.848493 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 134/250] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:50 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:50.911665 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:50.919460 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4b98e6a5-87b1-4b61-bbec-3962e4e7b02c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.507173 Mar 02 03:38:50.920334 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 117/251] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:50 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:51.865349 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:51.865959 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:51.872451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:51.872905 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:51.873680 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:51.874115 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:51.935870 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:51.936484 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:51.942705 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:51.943181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:51.943964 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:51.944393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:52.034529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:52.043173 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c6bd814a-2233-47f5-8d77-e4759a7420d3 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.181519 Mar 02 03:38:52.043751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 135/252] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:51 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:52.110801 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:52.118281 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-69b9efbd-87ea-41c7-923f-ae2b74fb86dc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.186341 Mar 02 03:38:52.118886 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 118/253] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:51 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:53.060820 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:53.061433 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:53.067699 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:53.068155 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:53.068933 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:53.069381 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:53.136896 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:53.137468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:53.143637 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:53.144082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:53.144852 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:53.145277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:53.254497 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:53.262692 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c92b6c47-6dba-4c98-86dc-1c16419db4fe tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.206353 Mar 02 03:38:53.267104 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 136/254] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:53 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:53.329306 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:53.337462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c506c893-955d-419e-80b1-8b8c52024824 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.205149 Mar 02 03:38:53.338270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 119/255] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:53 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:54.096593 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-657030707", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-546407427", "security_groups": [{"name": "tempest-secgroup-smoke-1978150563"}], "networks": [{"uuid": "e6ccb0b8-73d9-4435-8196-364781d2c238"}], "block_device_mapping_v2": [{"uuid": "2d845f30-7ef2-4ef5-8c3c-013a53bcd03c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:38:54.215327 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] validate_networks() for [('e6ccb0b8-73d9-4435-8196-364781d2c238', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:38:54.280531 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:54.281817 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:54.288479 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.294044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.295035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.301820 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.552138 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:54.560020 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6ff9dc40-782b-4158-8a7e-14fcd52cd7a2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.284109 Mar 02 03:38:54.560588 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 120/256] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:54 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:54.566073 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:54.570939 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:54.587113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.587901 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.589340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.589979 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.755996 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:38:54.756545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:38:54.757118 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:38:54.757546 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:38:54.757957 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:38:54.767839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.768299 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.769121 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.769565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.786397 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Getting quotas for project f70b0094f5e240b28b83102b4bab82cf. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:38:54.790790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Getting quotas for user 9ebebe6f704f4102a9560210b1d5e0ec and project f70b0094f5e240b28b83102b4bab82cf. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:38:54.809070 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:54.821376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dfccbaf6-c010-4e0b-81be-0db30b329173 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.258639 Mar 02 03:38:54.821376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 121/257] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:54 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:54.835877 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:54.836642 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:54.843660 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.854477 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.855915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:54.856547 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:54.865882 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:38:54.868083 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d845f30-7ef2-4ef5-8c3c-013a53bcd03c',volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:38:54.996346 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lazy-loading 'services' on Instance uuid 1e4602d0-7bdf-4d87-a748-e9b324e1a566 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:38:55.040064 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5651fc47-05d7-4430-9735-9dd571a003c8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.947334 Mar 02 03:38:55.047150 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 137/258] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:38:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:38:55.053308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1fe49859-acbe-4385-baa6-3683f1ccdbf9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:55.054118 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1fe49859-acbe-4385-baa6-3683f1ccdbf9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:55.174484 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-945b3917-1ea5-4254-9a98-0ebdf8bcb61a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-volume_attachments/02f96d00-f25d-45a0-bfb8-b9c3eef03241" status: 202 len: 0 microversion: 2.1 time: 0.342454 Mar 02 03:38:55.175236 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 122/259] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:38:54 2022] DELETE /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-volume_attachments/02f96d00-f25d-45a0-bfb8-b9c3eef03241 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:38:55.218699 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1fe49859-acbe-4385-baa6-3683f1ccdbf9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:55.226262 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1fe49859-acbe-4385-baa6-3683f1ccdbf9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1087 microversion: 2.1 time: 0.177623 Mar 02 03:38:55.228295 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 138/260] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:55 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1087 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:55.578230 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:55.578937 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:55.593998 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:55.594605 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:55.595589 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:55.596307 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:55.744572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:55.761359 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-09463439-5bfa-448a-9e52-62d7141ffb5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.186414 Mar 02 03:38:55.771193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 123/261] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:55 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:55.837647 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:55.838876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:55.844943 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:55.845398 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:55.846175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:55.846616 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:55.994770 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:56.002024 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-dc3284f3-1543-49d2-8196-3eab334240fa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.168250 Mar 02 03:38:56.002594 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 139/262] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:55 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:56.243512 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:56.244125 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:56.251269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:56.251725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:56.252504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:56.252940 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:56.328207 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:56.332731 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5a001070-0b8e-458d-b657-5cb0f5d1a236 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1137 microversion: 2.1 time: 0.093233 Mar 02 03:38:56.333462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 124/263] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:56 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:56.778721 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:56.779376 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:56.785659 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:56.786120 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:56.786900 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:56.787377 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:56.918612 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:56.926908 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3337dd45-fc65-4040-9a11-113dbf7c38fd tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.152334 Mar 02 03:38:56.927594 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 140/264] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:56 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:57.020013 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:57.020634 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:57.027461 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:57.027901 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:57.028777 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:57.029151 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:57.254592 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:57.263254 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6db5324a-7501-4219-9a94-776e893b8f25 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.246981 Mar 02 03:38:57.264080 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 125/265] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:57 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:57.350608 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:57.351850 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:57.363819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:57.364666 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:57.365782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:57.366212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:57.436644 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:57.444441 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-217541ee-fffa-4856-a5ec-5cb60b1c6e9a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1137 microversion: 2.1 time: 0.098333 Mar 02 03:38:57.451979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 141/266] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:57 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1137 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:57.944448 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:57.945381 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:57.951919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:57.952376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:57.953173 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:57.953613 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:58.095816 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:58.104320 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-03daa4ad-e446-4929-95a8-70af65cb6f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.162933 Mar 02 03:38:58.104919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 126/267] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:57 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:58.281242 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:58.281840 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:58.288088 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:58.288535 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:58.289315 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:58.289748 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:58.459167 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:58.462254 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:58.463465 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:58.469976 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:58.470485 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:58.471323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:58.471760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:58.474238 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b29dd6ef-a3bf-446b-962e-f0ee89477e1b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.196569 Mar 02 03:38:58.475516 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 142/268] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:58 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:58.544290 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:58.552377 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-05e71e18-f7a1-4e5b-b8c0-70ce195e440e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1137 microversion: 2.1 time: 0.093946 Mar 02 03:38:58.555557 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 127/269] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:58 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:38:59.121363 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:59.121884 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:59.127783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:59.128228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:59.128998 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:59.129431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:59.279790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:59.287660 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9c0e2bba-3422-43bc-9095-73eafd8f141f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.170318 Mar 02 03:38:59.288323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 143/270] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:59 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:59.494792 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:59.495861 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:59.506980 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:59.507800 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:59.509401 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:59.511432 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:59.574799 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:38:59.575921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:38:59.586885 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:59.588729 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:59.589769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:38:59.590464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:38:59.684529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:59.698901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6e7425fd-8581-4c20-b630-8a4f2e2e2928 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1137 microversion: 2.1 time: 0.131489 Mar 02 03:38:59.711844 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 144/271] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:59 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1137 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:38:59.734766 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:38:59.742005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-74399648-be9d-4c19-b506-e3e96a642e85 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.254355 Mar 02 03:38:59.742568 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 128/272] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:38:59 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:00.306106 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:00.306898 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:00.314791 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:00.315336 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:00.316285 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:00.316798 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:00.461365 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:00.469360 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-060db944-f775-44ea-bdfe-9d7e16e01182 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.168015 Mar 02 03:39:00.469924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 145/273] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:00 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:00.729712 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:00.730335 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:00.736719 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:00.737216 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:00.738200 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:00.738636 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:00.763110 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:00.763110 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:00.770204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:00.770658 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:00.771562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:00.772002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:00.819613 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:00.835453 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1ec7167b-67db-40f5-b72f-767f1df16ffd tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1137 microversion: 2.1 time: 0.110105 Mar 02 03:39:00.846096 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 129/274] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:00 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1137 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:00.931030 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:00.938976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d970269c-0f52-4a21-99d2-2579d194c479 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.182726 Mar 02 03:39:00.939576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 146/275] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:00 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:01.487224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:01.487846 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:01.494836 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:01.495322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:01.496126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:01.496569 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:01.648008 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:01.656100 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c505a157-061e-45b5-a746-32080de63ea9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.172572 Mar 02 03:39:01.656977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 130/276] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:01 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:01.854512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:01.855165 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:01.861700 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:01.862161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:01.862938 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:01.863409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:01.926078 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:01.933881 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fe0223ce-55c4-44ab-9dc8-ca4d837ad208 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1137 microversion: 2.1 time: 0.084006 Mar 02 03:39:01.934457 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 147/277] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:01 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:01.956488 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:01.957086 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:01.964627 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:01.965387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:01.966452 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:01.967142 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:02.110522 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:02.117760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4ea58cde-4f56-4c58-a89b-16bf78577aa7 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.165411 Mar 02 03:39:02.118311 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 131/278] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:01 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:02.672588 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:02.673344 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:02.680452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:02.680895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:02.682562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:02.682871 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:02.930094 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:02.938380 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-25e6a439-4bd3-4889-959f-7103d5158214 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.269380 Mar 02 03:39:02.953340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:02.954351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:02.959842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 148/279] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:02 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:02.961288 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:02.965653 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:02.966891 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:02.967604 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:03.047712 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:03.058144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f46a1f57-ae51-440a-8231-c6b42f71b9d6 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1129 microversion: 2.1 time: 0.108687 Mar 02 03:39:03.058828 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 132/280] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:02 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1129 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:03.136197 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:03.136847 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:03.142891 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:03.143370 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:03.144151 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:03.144587 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:03.398431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:03.406370 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-298a01a7-a15f-4412-8c22-dbbcf78d093b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1509 microversion: 2.1 time: 0.274824 Mar 02 03:39:03.407667 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 149/281] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:03 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:03.560828 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-a3d7f386-35f8-4202-8c63-67d1e5303e19 req-49252f78-608c-49f8-b02b-6dad3d4f26dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7fdc23-d2a1-4345-8b3d-9f8c0317898c", "tag": "11c6cb05-507a-4eff-87c3-ffaf5260ddc9"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:03.583502 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-a3d7f386-35f8-4202-8c63-67d1e5303e19 req-49252f78-608c-49f8-b02b-6dad3d4f26dc service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:03.583943 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-a3d7f386-35f8-4202-8c63-67d1e5303e19 req-49252f78-608c-49f8-b02b-6dad3d4f26dc service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:03.602339 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-a3d7f386-35f8-4202-8c63-67d1e5303e19 req-49252f78-608c-49f8-b02b-6dad3d4f26dc service nova] Creating event network-changed:11c6cb05-507a-4eff-87c3-ffaf5260ddc9 for instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c on hv-cinder-83109 Mar 02 03:39:03.609150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-a3d7f386-35f8-4202-8c63-67d1e5303e19 req-49252f78-608c-49f8-b02b-6dad3d4f26dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052683 Mar 02 03:39:03.610187 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 133/282] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:03.807317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:03.807819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:03.813863 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:03.814540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:03.815535 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:03.816175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:03.946510 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lazy-loading 'services' on Instance uuid e26b6d33-e3a8-4711-943e-240415615b75 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:39:03.956549 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:03.957502 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:03.972162 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:03.973328 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:03.974338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:03.974932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:04.111428 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f174d99a-d9c4-4ef6-9841-57368d977073 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75/os-volume_attachments/f754b009-8429-4a0b-8084-f899d5e4e4f1" status: 202 len: 0 microversion: 2.1 time: 0.307988 Mar 02 03:39:04.112712 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 150/283] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:39:03 2022] DELETE /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75/os-volume_attachments/f754b009-8429-4a0b-8084-f899d5e4e4f1 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:39:04.118970 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:04.119881 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:04.139434 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:04.140776 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:04.141824 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:04.142864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:04.260545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:04.268044 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-de7ffe0f-12ef-45ac-9ef4-d3fdffb327d3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1203 microversion: 2.1 time: 0.153790 Mar 02 03:39:04.268601 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 151/284] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:04 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:04.324857 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:04.332465 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3d7650f9-3e64-42f0-a47e-cbd67d8c90a8 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.380900 Mar 02 03:39:04.333047 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 134/285] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:03 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:04.425425 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:04.426147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:04.433391 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:04.433976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:04.434796 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:04.435330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:04.618463 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:04.628394 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-60ffcd0f-a88b-40b1-b6f6-07e563407bae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1515 microversion: 2.1 time: 0.206665 Mar 02 03:39:04.628991 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 152/286] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:04 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:04.896393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9a338845-204b-4ed7-be37-d1e86e91dbe4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:04.907224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9a338845-204b-4ed7-be37-d1e86e91dbe4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:04.908563 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9a338845-204b-4ed7-be37-d1e86e91dbe4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:04.944762 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9a338845-204b-4ed7-be37-d1e86e91dbe4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Going to try to stop instance {{(pid=123425) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 02 03:39:05.029106 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9a338845-204b-4ed7-be37-d1e86e91dbe4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action" status: 202 len: 0 microversion: 2.1 time: 0.140172 Mar 02 03:39:05.032897 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 135/287] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:39:04 2022] POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:39:05.043534 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:05.045317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:05.058226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:05.059213 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:05.060499 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:05.061245 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:05.287899 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:05.289280 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:05.299761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:05.300600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:05.301730 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:05.304819 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:05.334873 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:05.344428 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e02260a9-664e-420d-a710-1fdc27bd48f7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.310176 Mar 02 03:39:05.355453 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 153/288] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:05 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:05.360798 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:05.361429 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:05.367962 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:05.369191 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:05.370278 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:05.370722 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:05.491325 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:05.499921 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9f4ff6d0-af4c-48ce-b6c2-a094f763ab73 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.217917 Mar 02 03:39:05.500505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 136/289] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:05 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:05.556038 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:05.565230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-da03de9c-a4f0-4391-a2a9-b06e72800e51 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.208163 Mar 02 03:39:05.565882 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 154/290] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:05 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:05.673129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-59b99518-41c7-41e7-bdd8-d9a60d6af8cd req-6a4df9ce-6bba-4fdd-9531-b27ba684f421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3", "tag": "56da13d2-0bb5-44a6-b8fd-97adb1a22f9e"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:05.684408 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-59b99518-41c7-41e7-bdd8-d9a60d6af8cd req-6a4df9ce-6bba-4fdd-9531-b27ba684f421 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:05.685556 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-59b99518-41c7-41e7-bdd8-d9a60d6af8cd req-6a4df9ce-6bba-4fdd-9531-b27ba684f421 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:05.703084 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-59b99518-41c7-41e7-bdd8-d9a60d6af8cd req-6a4df9ce-6bba-4fdd-9531-b27ba684f421 service nova] Creating event network-changed:56da13d2-0bb5-44a6-b8fd-97adb1a22f9e for instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 on hv-cinder-83109 Mar 02 03:39:05.709239 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-59b99518-41c7-41e7-bdd8-d9a60d6af8cd req-6a4df9ce-6bba-4fdd-9531-b27ba684f421 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041054 Mar 02 03:39:05.709946 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 137/291] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:06.087224 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:06.088803 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:06.095155 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.095805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.096775 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.097390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.289421 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:06.309180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-571163d0-3000-4ce9-9334-3d86dda94231 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1515 microversion: 2.1 time: 0.226074 Mar 02 03:39:06.309862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 155/292] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:06 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:06.327368 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f2fd8131-08e3-4c8e-89e4-89dce8990938 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c4327a6-9a18-4585-99fc-2badbdf4b43a"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:06.328661 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f2fd8131-08e3-4c8e-89e4-89dce8990938 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:06.335260 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f2fd8131-08e3-4c8e-89e4-89dce8990938 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.335986 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f2fd8131-08e3-4c8e-89e4-89dce8990938 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.336775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f2fd8131-08e3-4c8e-89e4-89dce8990938 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.337239 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f2fd8131-08e3-4c8e-89e4-89dce8990938 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.340663 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:06.341170 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:06.347153 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.347820 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.348816 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.349522 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.379488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:39:06.461999 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1a6de3d3-f3e8-4f98-b77b-ac19a5fdb3fa tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 204 len: 0 microversion: 2.1 time: 0.125302 Mar 02 03:39:06.463457 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 156/293] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:39:06 2022] DELETE /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 02 03:39:06.472895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:06.473596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:06.480051 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.480708 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.481496 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.481942 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.663298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f2fd8131-08e3-4c8e-89e4-89dce8990938 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341496 Mar 02 03:39:06.668511 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 138/294] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:39:06 2022] POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:06.673603 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:06.674845 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:06.683822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.684363 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.685235 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.685779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.724485 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:06.732679 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-80d86638-7513-43e0-8289-01d0a8f11555 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.263942 Mar 02 03:39:06.733359 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 157/295] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:06 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:06.742466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:06.742466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:06.744850 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.745308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.746127 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.746547 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.958662 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:06.967012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-eda4a5b2-f16a-422a-af1b-8cdd9ec5fa78 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1515 microversion: 2.1 time: 0.301515 Mar 02 03:39:06.967617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 139/296] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:06 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1515 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:06.972069 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:06.972670 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:06.978899 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.979383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:06.980167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:06.980602 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:07.321302 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:07.330678 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1e2646d5-06ce-4d52-8464-040f479a0ac5 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.596305 Mar 02 03:39:07.331521 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 158/297] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:06 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:07.429024 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:07.438122 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2fcb099d-a605-48ff-92cb-cf2860f0bd94 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.469499 Mar 02 03:39:07.438702 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 140/298] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:06 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:07.751599 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:07.752212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:07.757876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:07.758357 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:07.759159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:07.759601 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:07.896056 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:07.903338 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-edd9f919-30be-445c-94d9-a0023a0a47ca tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.155659 Mar 02 03:39:07.903912 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 159/299] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:07 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:07.985025 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:07.985772 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:07.992661 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:07.993113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:07.995206 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:07.997292 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:08.125662 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:08.133184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-43a18fe3-c635-4057-91d7-c5ef918f1c1e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1515 microversion: 2.1 time: 0.152102 Mar 02 03:39:08.133746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 141/300] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:07 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:08.346529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:08.347174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:08.354066 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:08.354511 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:08.355412 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:08.355848 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:08.455574 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:08.456180 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:08.462270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:08.462745 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:08.463526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:08.463952 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:08.490751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:08.498855 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9c17f644-afb4-46e7-83ea-a28e71dfdb67 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.156067 Mar 02 03:39:08.499455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 160/301] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:08 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:08.593253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:08.600361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d0f12644-4aa5-4d9b-89ac-9a38fa5ade41 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.148822 Mar 02 03:39:08.600914 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 142/302] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:08 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:08.921786 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:08.922556 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:08.928504 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:08.929042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:08.929903 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:08.930350 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.150424 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:09.151239 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:09.156179 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:09.157767 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.158287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.159179 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.159621 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.163859 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8c7b74de-3c2b-4440-9b4a-cf4cfdf992d5 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.246000 Mar 02 03:39:09.164611 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 161/303] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:08 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:09.350572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:09.359270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2f3beb7d-3a6d-429f-903e-1d50e527c58a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1515 microversion: 2.1 time: 0.213342 Mar 02 03:39:09.368513 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 143/304] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:09 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:09.507742 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-04aee66a-a6b3-4f20-b630-ba7d39bf1539 req-53868acd-91ec-4a67-95a7-05d8e5159e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26b6d33-e3a8-4711-943e-240415615b75", "name": "network-vif-deleted", "tag": "9904e835-5866-4716-970a-00e8b74ac7f0"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:09.517311 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:09.517924 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:09.519716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-04aee66a-a6b3-4f20-b630-ba7d39bf1539 req-53868acd-91ec-4a67-95a7-05d8e5159e3d service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.520166 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-04aee66a-a6b3-4f20-b630-ba7d39bf1539 req-53868acd-91ec-4a67-95a7-05d8e5159e3d service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.533828 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-04aee66a-a6b3-4f20-b630-ba7d39bf1539 req-53868acd-91ec-4a67-95a7-05d8e5159e3d service nova] Creating event network-vif-deleted:9904e835-5866-4716-970a-00e8b74ac7f0 for instance e26b6d33-e3a8-4711-943e-240415615b75 on hv-cinder-83109 Mar 02 03:39:09.536531 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.539512 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.541201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-04aee66a-a6b3-4f20-b630-ba7d39bf1539 req-53868acd-91ec-4a67-95a7-05d8e5159e3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036531 Mar 02 03:39:09.542410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 162/305] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:09.543237 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.545156 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.564698 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-946d5b4f-5113-4b51-acd0-c230bb8254bc req-85761dad-0954-492b-8131-996b19bcc6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7fdc23-d2a1-4345-8b3d-9f8c0317898c", "name": "network-vif-plugged", "status": "completed", "tag": "11c6cb05-507a-4eff-87c3-ffaf5260ddc9"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:09.574284 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-946d5b4f-5113-4b51-acd0-c230bb8254bc req-85761dad-0954-492b-8131-996b19bcc6da service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.574904 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-946d5b4f-5113-4b51-acd0-c230bb8254bc req-85761dad-0954-492b-8131-996b19bcc6da service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.596372 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-946d5b4f-5113-4b51-acd0-c230bb8254bc req-85761dad-0954-492b-8131-996b19bcc6da service nova] Creating event network-vif-plugged:11c6cb05-507a-4eff-87c3-ffaf5260ddc9 for instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c on hv-cinder-83109 Mar 02 03:39:09.606003 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-946d5b4f-5113-4b51-acd0-c230bb8254bc req-85761dad-0954-492b-8131-996b19bcc6da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045218 Mar 02 03:39:09.607292 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 163/306] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:39:09.617651 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:09.618694 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:09.625347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.626135 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.627275 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:09.627979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:09.743286 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:09.752198 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-91b1c1fd-8fb9-4bd3-98ca-78395e3faff9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.239299 Mar 02 03:39:09.753002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 144/307] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:09 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:09.822317 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:09.830054 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c020b500-2832-42b6-adca-b8f92ecc95e9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.216178 Mar 02 03:39:09.830512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 164/308] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:09 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:10.180516 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:10.181642 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:10.187912 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.188366 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.189152 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.189590 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.322771 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:10.330035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8d442122-ccfb-4aa9-9d08-8088fef595b9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.153239 Mar 02 03:39:10.330605 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 145/309] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:10 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:10.376145 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:10.376862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:10.382735 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.383226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.384603 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.385334 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.414957 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.415648 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.416527 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lazy-loading 'fault' on Instance uuid e26b6d33-e3a8-4711-943e-240415615b75 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:39:10.463298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:10.469887 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-44fe3ed6-335e-4c95-8dfb-6e036e01d11f tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 200 len: 1309 microversion: 2.1 time: 0.097603 Mar 02 03:39:10.470448 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 165/310] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:10 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:10.769797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:10.770407 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:10.776523 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.776968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.777732 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.778161 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.846485 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:10.847111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:10.853885 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.854330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.855122 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:10.855555 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:10.945142 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:10.952771 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ed636273-5068-47b2-a564-c7db6e18da04 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.186879 Mar 02 03:39:10.953535 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 146/311] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:10 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:11.010047 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:11.017388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-81d597a3-4e82-41c2-a251-e70f11bfc67c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1357 microversion: 2.1 time: 0.174709 Mar 02 03:39:11.017958 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 166/312] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:10 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:11.348184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:11.348859 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:11.355852 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:11.356294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:11.357061 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:11.357492 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:11.487395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:11.488043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: e26b6d33-e3a8-4711-943e-240415615b75] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:11.492956 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:11.494662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:11.495138 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:11.495927 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:11.496361 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:11.500215 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-509e0aa4-b486-4edd-bd28-3351ae8a1c6c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.155897 Mar 02 03:39:11.500786 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 147/313] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:11 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:11.511514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] HTTP exception thrown: Instance e26b6d33-e3a8-4711-943e-240415615b75 could not be found. Mar 02 03:39:11.512105 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Returning 404 to user: Instance e26b6d33-e3a8-4711-943e-240415615b75 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:39:11.512926 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2330fc90-861d-484d-858a-9c5b129a2bd6 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75" status: 404 len: 111 microversion: 2.1 time: 0.029491 Mar 02 03:39:11.513445 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 167/314] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:11 2022] GET /compute/v2.1/servers/e26b6d33-e3a8-4711-943e-240415615b75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:39:11.970436 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:11.971665 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:11.978343 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:11.978961 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:11.979808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:11.980239 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.034414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:12.035024 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:12.041809 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.042291 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.043077 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.043524 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.141898 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:12.149158 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-91edd8f5-dd3a-4c82-ab66-d9dc060f356a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.183354 Mar 02 03:39:12.150404 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 148/315] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:11 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:12.209518 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:12.217474 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e4915c0a-f05a-4b0e-a243-ae0fee3a93ac tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1548 microversion: 2.1 time: 0.186983 Mar 02 03:39:12.218027 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 168/316] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:12 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:12.234119 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:12.234736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:12.240645 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.241103 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.241883 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.242322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.370756 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:12.378625 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e8e20458-43a3-4dba-982a-9e0f9ab2e128 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1548 microversion: 2.1 time: 0.148372 Mar 02 03:39:12.379207 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 149/317] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:12 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:12.394524 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:12.398102 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:12.398873 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Searching by: {'deleted': False, 'project_id': '7e6b3df4db8641899040ec5bed522a1f'} {{(pid=123426) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 02 03:39:12.405492 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.405943 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.406766 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.407241 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.495608 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.multi_cell_list [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 02 03:39:12.517711 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:12.518315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:12.524091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.525228 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.526247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.526719 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.598182 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bd337da1-d183-457c-939a-fe5a35ddce57 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207261 Mar 02 03:39:12.598767 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 169/318] 10.222.0.23 () {58 vars in 1124 bytes} [Wed Mar 2 03:39:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:12.609179 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:12.609800 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:12.615602 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.616058 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.616845 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:12.617287 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:12.667478 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:12.674676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b8433853-217d-4df9-9a75-96d91ae7bf8c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.160788 Mar 02 03:39:12.675282 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 150/319] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:12 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:12.760990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:12.768301 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-442c3848-613d-4921-88b0-6174d2af6f03 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1548 microversion: 2.1 time: 0.162698 Mar 02 03:39:12.768872 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 170/320] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:12 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:13.167011 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:13.167643 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:13.173573 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:13.174027 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:13.174842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:13.175309 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:13.308237 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:13.315390 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4fab0f2e-4ec7-482e-9819-feace2342905 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.152739 Mar 02 03:39:13.315958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 151/321] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:13 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:13.693371 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:13.693371 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:13.700165 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:13.700617 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:13.701397 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:13.701832 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:13.838817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:13.846075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-002cb64d-e738-4c01-8f0e-e9105b247a74 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.157406 Mar 02 03:39:13.846658 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 171/322] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:13 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:14.332693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:14.333237 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:14.339627 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:14.340078 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:14.340849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:14.341315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:14.479856 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:14.487071 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3af6405b-3cd9-4969-8485-af0c64a07138 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.158550 Mar 02 03:39:14.487636 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 152/323] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:14 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:14.863252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:14.863860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:14.870911 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:14.871335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:14.872102 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:14.872536 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:15.004038 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:15.011875 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bd215892-4085-48b1-95f6-99fa3f30ea4e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1678 microversion: 2.1 time: 0.152538 Mar 02 03:39:15.012440 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 172/324] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:14 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:15.315505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-37d09ad4-c3c2-4faa-8889-0aff91cf1bc4 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d889b24-9d1a-4f51-a19b-dd0438e3646d"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:15.316618 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-37d09ad4-c3c2-4faa-8889-0aff91cf1bc4 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:15.322397 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37d09ad4-c3c2-4faa-8889-0aff91cf1bc4 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:15.322844 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37d09ad4-c3c2-4faa-8889-0aff91cf1bc4 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:15.323643 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37d09ad4-c3c2-4faa-8889-0aff91cf1bc4 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:15.324078 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-37d09ad4-c3c2-4faa-8889-0aff91cf1bc4 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:15.504269 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:15.504913 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:15.511413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:15.511862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:15.512636 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:15.513099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:15.619286 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-37d09ad4-c3c2-4faa-8889-0aff91cf1bc4 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307502 Mar 02 03:39:15.620564 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 153/325] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:39:15 2022] POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:15.691335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:15.698669 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-042f502b-03cd-43e9-aacf-4efc3b736b1b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.198162 Mar 02 03:39:15.699274 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 173/326] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:15 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:16.029637 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:16.030332 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:16.036729 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.037174 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.037969 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.038399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.171758 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:16.178828 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dd2461ef-0040-4c4c-9326-7e23c84aff33 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1655 microversion: 2.1 time: 0.153291 Mar 02 03:39:16.179410 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 154/327] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:16 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:16.195393 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6c6daf3a-fc75-456e-8f1f-5b38ebba3b1c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:16.202374 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6c6daf3a-fc75-456e-8f1f-5b38ebba3b1c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.202825 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6c6daf3a-fc75-456e-8f1f-5b38ebba3b1c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.226845 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6c6daf3a-fc75-456e-8f1f-5b38ebba3b1c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Going to try to start instance {{(pid=123426) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 02 03:39:16.270978 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:16.271580 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6c6daf3a-fc75-456e-8f1f-5b38ebba3b1c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action" status: 202 len: 0 microversion: 2.1 time: 0.079366 Mar 02 03:39:16.272010 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:16.272448 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 174/328] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:39:16 2022] POST /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:39:16.278013 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.278778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.279779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.280375 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.282887 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:16.283954 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:16.290731 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.291785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.292958 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.293890 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.309456 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lazy-loading 'flavor' on Instance uuid 3a6146a9-fa07-430b-97f6-0e4174847543 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:39:16.449936 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e4f3f956-1764-4450-9a6b-7983f7c777b9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action" status: 200 len: 32 microversion: 2.1 time: 0.183128 Mar 02 03:39:16.454917 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 155/329] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:39:16 2022] POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:39:16.466373 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:16.467348 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:16.473913 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.474366 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.475252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.475687 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.480097 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:16.489002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fdee3e36-8577-4540-b796-3a0345f83a86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1664 microversion: 2.1 time: 0.211863 Mar 02 03:39:16.489588 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 175/330] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:16 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1664 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:16.715971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:16.716795 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:16.722603 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.723016 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.724167 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:16.724796 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:16.726321 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:16.745178 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-93d05dc6-2dc8-48c6-82a6-d96ba25df56a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.279047 Mar 02 03:39:16.751625 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 156/331] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:16 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:16.941547 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:16.949149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e98d007b-a196-4b2f-8ce1-b592a3ef6583 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.237189 Mar 02 03:39:16.949777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 176/332] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:16 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:17.507340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:17.507945 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:17.514375 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:17.514822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:17.515618 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:17.516049 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:17.655761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:17.663091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f76922fb-c644-4b42-9f8a-4370da3e8ea1 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1664 microversion: 2.1 time: 0.159797 Mar 02 03:39:17.663663 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 157/333] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:17 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:17.757491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:17.758109 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:17.765194 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:17.765648 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:17.766441 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:17.766880 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:17.898023 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:17.906069 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-884ba2d7-bf21-4d05-8034-bdc7293d536f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.152402 Mar 02 03:39:17.906631 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 177/334] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:17 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:17.967034 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:17.967620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:17.973412 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:17.973867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:17.974646 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:17.975139 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:18.110129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:18.117357 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5dfc4a98-263b-4e30-8cc3-2f61327b2b83 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.154267 Mar 02 03:39:18.118620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 158/335] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:17 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:18.682352 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:18.683471 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:18.689330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:18.689783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:18.690558 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:18.690995 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:18.823944 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:18.832103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-75ae5ca5-947e-4e90-926c-9096c44d3ee7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1664 microversion: 2.1 time: 0.154254 Mar 02 03:39:18.832757 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 178/336] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:18 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:18.922644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:18.923270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:18.929406 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:18.929851 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:18.930652 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:18.931110 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:19.061925 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:19.069556 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7f90dc40-861a-47e9-833d-485378b60ffe tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.150725 Mar 02 03:39:19.070112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 159/337] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:18 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:19.134415 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:19.135595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:19.141375 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:19.141821 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:19.142596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:19.143034 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:19.279707 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:19.286780 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7ade7975-9325-4de9-943d-43330bfef416 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.156204 Mar 02 03:39:19.287373 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 179/338] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:19 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:19.849213 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:19.849817 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:19.856508 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:19.856956 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:19.857727 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:19.858160 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:19.987930 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:19.995526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2abddf2e-00c2-418f-9428-eb8b8467ae49 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1664 microversion: 2.1 time: 0.150104 Mar 02 03:39:19.996095 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 160/339] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:19 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:20.086280 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:20.086823 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:20.093518 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:20.093964 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:20.094732 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:20.095202 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:20.234914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:20.243260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-59d964e2-46cb-40e8-9823-65981b09df23 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.160818 Mar 02 03:39:20.243830 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 180/340] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:20 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:20.303096 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:20.303707 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:20.310059 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:20.310518 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:20.311320 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:20.311756 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:20.347359 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1328800270", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "0d399a0a-ad54-4ab5-920e-fb92454143ae"}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:20.397697 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] validate_networks() for [('0d399a0a-ad54-4ab5-920e-fb92454143ae', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:39:20.504578 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:20.512138 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d2036df5-7d29-4798-b0bd-056494f657be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.212820 Mar 02 03:39:20.512714 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 161/341] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:20 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:20.770860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:39:20.771331 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:39:20.771809 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:39:20.772219 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:39:20.772630 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:39:20.782493 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:20.782947 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:20.783794 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:20.784231 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:20.800914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Getting quotas for project 81dac378b4f74c5d972b52cde9208383. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:39:20.804803 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Getting quotas for user 875e1eaabbfa482b8897bca1ce980893 and project 81dac378b4f74c5d972b52cde9208383. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:39:20.815932 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:39:20.818154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:39:20.862661 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9404c35f-75f6-447a-a165-9d1b4c6623db tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519109 Mar 02 03:39:20.863250 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 181/342] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:39:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:39:20.873708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-402ef3d4-d214-44f3-bad0-9601fa479542 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:20.874316 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-402ef3d4-d214-44f3-bad0-9601fa479542 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:20.927952 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-402ef3d4-d214-44f3-bad0-9601fa479542 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:20.935930 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-402ef3d4-d214-44f3-bad0-9601fa479542 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1219 microversion: 2.1 time: 0.066581 Mar 02 03:39:20.936499 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 162/343] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:20 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:21.013126 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:21.013853 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:21.020159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.020613 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:21.021385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.021822 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:21.162455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:21.169811 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a6c8366d-db9e-4f3b-b5ab-486130febd3c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1668 microversion: 2.1 time: 0.161159 Mar 02 03:39:21.178784 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 182/344] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:21 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:21.261648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:21.262257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:21.268395 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.268852 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:21.269639 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.270351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:21.409038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:21.417012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0c95c4f3-7cfc-4987-83cc-48baba311b0f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.160230 Mar 02 03:39:21.417792 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 163/345] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:21 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:21.529709 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:21.530356 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:21.536362 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.536817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:21.537606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.538077 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:21.674717 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:21.682612 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a46fcbe1-1c90-496c-89bd-4fe9f5ee1b64 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.157387 Mar 02 03:39:21.683211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 183/346] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:21 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:21.953101 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:21.953655 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:21.960265 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.960726 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:21.961490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:21.961928 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:22.028747 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:22.035900 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-19d29d53-aa5c-4d74-88b3-20db9cb79e09 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1271 microversion: 2.1 time: 0.086721 Mar 02 03:39:22.036462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 164/347] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:21 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:22.184761 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-f1494287-494a-443f-a898-5ff578d84b4e req-d96c0658-9df5-4e86-8a40-23ccf8a0a11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3", "name": "network-vif-plugged", "status": "completed", "tag": "56da13d2-0bb5-44a6-b8fd-97adb1a22f9e"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:22.192927 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f1494287-494a-443f-a898-5ff578d84b4e req-d96c0658-9df5-4e86-8a40-23ccf8a0a11c service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:22.193443 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f1494287-494a-443f-a898-5ff578d84b4e req-d96c0658-9df5-4e86-8a40-23ccf8a0a11c service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:22.208335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-f1494287-494a-443f-a898-5ff578d84b4e req-d96c0658-9df5-4e86-8a40-23ccf8a0a11c service nova] Creating event network-vif-plugged:56da13d2-0bb5-44a6-b8fd-97adb1a22f9e for instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 on hv-cinder-83109 Mar 02 03:39:22.213403 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-f1494287-494a-443f-a898-5ff578d84b4e req-d96c0658-9df5-4e86-8a40-23ccf8a0a11c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032554 Mar 02 03:39:22.214025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 184/348] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:22.433968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:22.434846 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:22.444955 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:22.445925 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:22.446905 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:22.448395 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:22.700931 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:22.701128 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:22.702036 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:22.708263 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:22.708716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:22.709307 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-12d420bc-8907-4eb5-9d15-9c4b668e704c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.279423 Mar 02 03:39:22.709497 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:22.709884 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 165/349] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:22 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:22.716184 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:22.945093 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:22.952379 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-72ead7ff-1b54-4650-8ce4-e4655c13483b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.256651 Mar 02 03:39:22.952949 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 185/350] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:22 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:23.055269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:23.055795 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:23.065264 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.065952 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.066699 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.067372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.186388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:23.187012 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:23.193209 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.193662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.194466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.194885 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.337145 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:23.344367 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-fab8b4bc-fd11-4d2c-a0c6-2335f66b6222 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.294487 Mar 02 03:39:23.345132 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 166/351] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:23 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:23.729080 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:23.729823 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:23.732937 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:23.736327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.736327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.737759 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.737759 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.741163 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f9b60f65-cbcb-43a5-946b-5373ad566ad2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1594 microversion: 2.1 time: 0.559555 Mar 02 03:39:23.741802 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 186/352] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:23 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1594 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:23.969990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:23.970862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:23.977710 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.978161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.979793 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:23.980809 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:23.995481 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:24.010256 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-fac0d5b3-141b-4f74-9c27-b60a2c3265fd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.285505 Mar 02 03:39:24.020031 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 167/353] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:23 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:24.262666 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:24.270427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9b89b3cd-7a27-45af-9399-c99c84c8b104 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1259 microversion: 2.1 time: 0.304358 Mar 02 03:39:24.280295 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 187/354] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:23 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:24.362006 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:24.362767 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:24.370454 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:24.371042 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:24.372154 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:24.372692 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:24.402908 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-4a3034ff-64f9-444d-b9a3-0b9c79db3bea req-68072781-daa4-43ba-93fe-5d7b0cdfb226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4cc78a-0eee-414f-b94c-ce46d164cbd9", "tag": "0c2e3082-1fd0-46cf-943c-d66856ae42a9"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:24.415377 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-4a3034ff-64f9-444d-b9a3-0b9c79db3bea req-68072781-daa4-43ba-93fe-5d7b0cdfb226 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:24.418341 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-4a3034ff-64f9-444d-b9a3-0b9c79db3bea req-68072781-daa4-43ba-93fe-5d7b0cdfb226 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:24.435170 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-4a3034ff-64f9-444d-b9a3-0b9c79db3bea req-68072781-daa4-43ba-93fe-5d7b0cdfb226 service nova] Creating event network-changed:0c2e3082-1fd0-46cf-943c-d66856ae42a9 for instance ee4cc78a-0eee-414f-b94c-ce46d164cbd9 on hv-cinder-83109 Mar 02 03:39:24.440020 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-4a3034ff-64f9-444d-b9a3-0b9c79db3bea req-68072781-daa4-43ba-93fe-5d7b0cdfb226 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041032 Mar 02 03:39:24.441242 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 188/355] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:24.613815 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:24.623477 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-503fe843-0640-4159-be0a-c42fd6588ec9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.265471 Mar 02 03:39:24.624060 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 168/356] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:24 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:25.029268 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:25.030782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:25.037393 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.037846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.038662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.039835 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.287879 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:25.289094 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:25.293357 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:25.297290 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.297744 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.298537 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.298954 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.301093 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a924ba98-f757-4895-b914-2f037bd4fd53 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.277341 Mar 02 03:39:25.301664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 189/357] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:25 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:25.560511 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:25.568492 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-eff77689-4fc4-4f09-b6ad-c66f9ab11192 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1444 microversion: 2.1 time: 0.284529 Mar 02 03:39:25.569392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 169/358] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:25 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1444 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:25.586595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:25.587239 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:25.593333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.594024 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.594858 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.595381 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.641619 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:25.642375 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:25.654297 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.654840 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.655725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.656228 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.775571 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:25.784541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-04b25eb3-37ec-439b-bbb8-954c7592424a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1444 microversion: 2.1 time: 0.201267 Mar 02 03:39:25.785253 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 190/359] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:25 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1444 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:25.849663 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:25.859360 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4e607d38-63c9-49f1-a6a2-e9477673a14a tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.221308 Mar 02 03:39:25.860753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 170/360] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:25 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:25.909436 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-cc54cf1c-7ad4-4b5b-977c-644490aa07fc req-c7597eff-aac3-4bf8-9eb3-347adfbc6335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7fdc23-d2a1-4345-8b3d-9f8c0317898c", "tag": "11c6cb05-507a-4eff-87c3-ffaf5260ddc9"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:25.917384 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-cc54cf1c-7ad4-4b5b-977c-644490aa07fc req-c7597eff-aac3-4bf8-9eb3-347adfbc6335 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:25.917833 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-cc54cf1c-7ad4-4b5b-977c-644490aa07fc req-c7597eff-aac3-4bf8-9eb3-347adfbc6335 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:25.929487 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-cc54cf1c-7ad4-4b5b-977c-644490aa07fc req-c7597eff-aac3-4bf8-9eb3-347adfbc6335 service nova] Creating event network-changed:11c6cb05-507a-4eff-87c3-ffaf5260ddc9 for instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c on hv-cinder-83109 Mar 02 03:39:25.935153 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-cc54cf1c-7ad4-4b5b-977c-644490aa07fc req-c7597eff-aac3-4bf8-9eb3-347adfbc6335 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029327 Mar 02 03:39:25.935743 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 191/361] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:26.318431 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:26.318969 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:26.330104 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:26.330549 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:26.331356 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:26.331966 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:26.633101 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:26.646505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5ab72d07-8e27-4359-b183-88cb73252222 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.331609 Mar 02 03:39:26.647725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 171/362] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:26 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:26.877264 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:26.877976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:26.885490 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:26.885977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:26.886779 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:26.887513 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:27.084160 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:27.098644 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-33febee1-fc8d-4fa1-80df-dfb24583e118 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.225497 Mar 02 03:39:27.101424 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 192/363] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:26 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:27.421948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1599983077"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:27.422522 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:27.428860 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:27.429310 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:27.430088 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:27.430522 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:27.562474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.network.security_group_api [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Adding security group 536ddb33-f68a-47ef-afcb-e05c974b56c3 to port 11c6cb05-507a-4eff-87c3-ffaf5260ddc9 Mar 02 03:39:27.664384 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:27.665262 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:27.672081 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:27.672759 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:27.673727 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:27.674346 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:27.909952 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:27.922306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b6724529-a488-4ba9-bef1-543de66c2220 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.261649 Mar 02 03:39:27.922976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 193/364] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:27 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:27.967403 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-f33e2b12-7dc0-4d23-8f4f-cadbe5b40bd3 req-8ccdb6bf-7f49-4089-9517-908b9d20869b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3", "tag": "56da13d2-0bb5-44a6-b8fd-97adb1a22f9e"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:27.975773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f33e2b12-7dc0-4d23-8f4f-cadbe5b40bd3 req-8ccdb6bf-7f49-4089-9517-908b9d20869b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:27.976202 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f33e2b12-7dc0-4d23-8f4f-cadbe5b40bd3 req-8ccdb6bf-7f49-4089-9517-908b9d20869b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:27.988333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-f33e2b12-7dc0-4d23-8f4f-cadbe5b40bd3 req-8ccdb6bf-7f49-4089-9517-908b9d20869b service nova] Creating event network-changed:56da13d2-0bb5-44a6-b8fd-97adb1a22f9e for instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 on hv-cinder-83109 Mar 02 03:39:27.995759 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-f33e2b12-7dc0-4d23-8f4f-cadbe5b40bd3 req-8ccdb6bf-7f49-4089-9517-908b9d20869b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039757 Mar 02 03:39:27.996660 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 194/365] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:28.027862 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9aaa8718-91fd-495e-9cb7-ae46dbdd16af tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/action" status: 202 len: 0 microversion: 2.1 time: 0.609786 Mar 02 03:39:28.028464 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 172/366] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:39:27 2022] POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:39:28.037143 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:28.037843 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:28.047151 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-ef6e1ec4-db2e-48d7-b600-7879d8f3038d req-faef2ef3-100d-4be3-a1d9-0598aec594c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7fdc23-d2a1-4345-8b3d-9f8c0317898c", "tag": "11c6cb05-507a-4eff-87c3-ffaf5260ddc9"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:28.047819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:28.048348 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:28.051497 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:28.052199 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:28.064958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-ef6e1ec4-db2e-48d7-b600-7879d8f3038d req-faef2ef3-100d-4be3-a1d9-0598aec594c0 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:28.065678 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-ef6e1ec4-db2e-48d7-b600-7879d8f3038d req-faef2ef3-100d-4be3-a1d9-0598aec594c0 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:28.090354 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-ef6e1ec4-db2e-48d7-b600-7879d8f3038d req-faef2ef3-100d-4be3-a1d9-0598aec594c0 service nova] Creating event network-changed:11c6cb05-507a-4eff-87c3-ffaf5260ddc9 for instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c on hv-cinder-83109 Mar 02 03:39:28.096669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-ef6e1ec4-db2e-48d7-b600-7879d8f3038d req-faef2ef3-100d-4be3-a1d9-0598aec594c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053830 Mar 02 03:39:28.101472 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 173/367] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:39:28.119753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:28.123382 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:28.157146 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:28.157866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:28.159183 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:28.159794 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:28.450783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:28.463446 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b711e47d-b699-4ce5-8e6c-6ee2b382d965 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1759 microversion: 2.1 time: 0.430444 Mar 02 03:39:28.464351 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 195/368] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:28 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1759 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:28.535259 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:28.545761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d03a6912-4b15-49ea-8a1b-599e7e39867e tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.431619 Mar 02 03:39:28.555928 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 174/369] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:28 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:28.942472 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:28.944029 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:28.951407 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:28.953356 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:28.954665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:28.955453 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:29.113491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:29.122842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4c7da996-36f6-4252-be4e-ff56ef8ccf51 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.186243 Mar 02 03:39:29.123801 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 196/370] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:28 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:29.564733 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:29.565304 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:29.571598 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:29.572344 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:29.572916 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:29.573352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:29.700566 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:29.707880 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f175ea8a-05e6-4535-8a43-ade08badc319 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.147078 Mar 02 03:39:29.708441 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 175/371] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:29 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:30.140844 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:30.141388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:30.147743 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:30.148198 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:30.148985 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:30.149428 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:30.284024 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:30.291819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5caefa31-57e9-4586-8fd7-396c3bbabd59 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.154910 Mar 02 03:39:30.292378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 197/372] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:30 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:30.724946 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:30.725558 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:30.731854 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:30.732304 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:30.733075 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:30.733508 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:30.861892 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:30.869760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-adbac37b-ee95-45c3-ba2f-71ce592f8382 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.148597 Mar 02 03:39:30.870319 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 176/373] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:30 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:31.308450 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:31.309059 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:31.315273 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:31.315720 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:31.316485 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:31.316921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:31.451260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:31.459192 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-112a4630-c73f-49f6-9c77-13bb3a6c789a tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.154858 Mar 02 03:39:31.459762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 198/374] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:31 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:31.886487 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:31.887112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:31.894554 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:31.894999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:31.895821 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:31.896253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:32.029640 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:32.036938 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-96aa7fc4-e96f-45b1-9327-30bfb898cbdd tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.154271 Mar 02 03:39:32.037492 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 177/375] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:31 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:32.227756 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-8d55924e-c18c-4b7f-a982-01e3b9f7a32a req-63529990-d5fb-4f00-b923-c26bf4b439fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cc78a-0eee-414f-b94c-ce46d164cbd9", "name": "network-vif-plugged", "status": "completed", "tag": "0c2e3082-1fd0-46cf-943c-d66856ae42a9"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:32.235889 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-8d55924e-c18c-4b7f-a982-01e3b9f7a32a req-63529990-d5fb-4f00-b923-c26bf4b439fa service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:32.236351 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-8d55924e-c18c-4b7f-a982-01e3b9f7a32a req-63529990-d5fb-4f00-b923-c26bf4b439fa service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:32.248525 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-8d55924e-c18c-4b7f-a982-01e3b9f7a32a req-63529990-d5fb-4f00-b923-c26bf4b439fa service nova] Creating event network-vif-plugged:0c2e3082-1fd0-46cf-943c-d66856ae42a9 for instance ee4cc78a-0eee-414f-b94c-ce46d164cbd9 on hv-cinder-83109 Mar 02 03:39:32.253515 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-8d55924e-c18c-4b7f-a982-01e3b9f7a32a req-63529990-d5fb-4f00-b923-c26bf4b439fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029433 Mar 02 03:39:32.254103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 199/376] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:32.477252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:32.478277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:32.484450 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:32.484898 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:32.485697 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:32.486127 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:32.648245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:32.656125 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dd59b569-9bea-4a31-9c48-79f631277432 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.183054 Mar 02 03:39:32.656681 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 178/377] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:32 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:33.054148 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:33.054881 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:33.061998 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:33.062448 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:33.063262 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:33.063702 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:33.197074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:33.204576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d1daad7b-e9bc-4d31-b2a2-59d8c06270b7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.154657 Mar 02 03:39:33.205142 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 200/378] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:33 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:33.674108 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:33.675120 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:33.681768 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:33.682212 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:33.682982 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:33.683432 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:34.044106 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:34.051747 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-55b381f0-3d84-4cb8-83a2-ec1e2d55eac1 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.381647 Mar 02 03:39:34.052296 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 179/379] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:33 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:34.221914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:34.222452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:34.228751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:34.229197 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:34.229973 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:34.230406 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:34.366065 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:34.373813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2385b2f9-d5a3-4c40-b661-0f2112b4cea2 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1319 microversion: 2.1 time: 0.155940 Mar 02 03:39:34.374387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 201/380] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:34 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:35.068647 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:35.069247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:35.075659 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:35.076105 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:35.076867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:35.077298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:35.211329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:35.219488 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5b7117df-edeb-48da-81c6-c323321d7919 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.154614 Mar 02 03:39:35.220049 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 180/381] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:35 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:35.390701 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:35.391344 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:35.397649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:35.398102 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:35.398877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:35.399356 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:35.528278 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:35.535816 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0debed5c-ab2a-4687-8b4e-27e6b86c5431 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1508 microversion: 2.1 time: 0.148948 Mar 02 03:39:35.536377 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 202/382] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:35 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:35.552780 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f41e271f-9d8d-4fb8-a41f-9600ae3b79d9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9946598-a7be-4283-8bc3-abdb276dc6ce", "device": "/dev/sdb"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:35.553904 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f41e271f-9d8d-4fb8-a41f-9600ae3b79d9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:35.560459 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f41e271f-9d8d-4fb8-a41f-9600ae3b79d9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:35.560902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f41e271f-9d8d-4fb8-a41f-9600ae3b79d9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:35.561664 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f41e271f-9d8d-4fb8-a41f-9600ae3b79d9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:35.562104 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f41e271f-9d8d-4fb8-a41f-9600ae3b79d9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:35.816842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f41e271f-9d8d-4fb8-a41f-9600ae3b79d9 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "POST /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267868 Mar 02 03:39:35.817546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 181/383] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:39:35 2022] POST /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:39:36.237014 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:36.237628 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:36.243755 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:36.244262 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:36.245039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:36.245480 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:36.378595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:36.387224 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5c884324-d1fe-45af-93a3-111e03e198f9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.154025 Mar 02 03:39:36.387785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 203/384] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:36 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:37.405352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:37.406044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:37.412772 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:37.413222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:37.414008 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:37.414443 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:37.547645 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:37.555209 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-da4ec1b7-65bf-4793-aeb8-0c5f7a379420 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.154548 Mar 02 03:39:37.556388 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 182/385] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:37 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:38.573191 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:38.573805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:38.580095 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:38.580550 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:38.581330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:38.581773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:38.711342 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:38.719780 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8478a5aa-f4cf-4cc8-9d76-369080a2812b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.151002 Mar 02 03:39:38.720345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 204/386] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:38 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:39.736615 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:39.737221 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:39.743457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:39.743896 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:39.744662 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:39.745091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:39.878252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:39.886584 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-80e9b952-ac56-41d3-9946-a127f56c0ce9 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.153806 Mar 02 03:39:39.887161 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 183/387] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:39 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:40.904159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:40.904803 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:40.911028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:40.911510 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:40.912289 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:40.912731 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:41.042293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:41.050023 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7e93cf3b-4a54-458b-aa8c-84ad18bec215 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.149862 Mar 02 03:39:41.050592 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 205/388] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:40 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:42.067281 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:42.067868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:42.074471 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:42.074900 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:42.075693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:42.076124 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:42.251245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:42.260878 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3aeae71c-fe0e-4500-a220-933f130bcdcc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.197420 Mar 02 03:39:42.261440 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 184/389] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:42 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:43.279256 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:43.279878 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:43.285803 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:43.286254 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:43.287034 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:43.287494 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:43.430802 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:43.438764 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-92fd0cfb-12ca-4067-ac80-207eda21f669 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.163427 Mar 02 03:39:43.439371 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 206/390] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:43 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:44.456374 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:44.456989 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:44.463446 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:44.463896 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:44.464671 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:44.465142 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:44.597850 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:44.605951 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1ba2e428-6ce3-4dfe-8718-bc0946230011 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.153641 Mar 02 03:39:44.606514 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 185/391] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:44 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:45.622575 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:45.623250 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:45.629575 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:45.630029 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:45.630805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:45.631275 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:45.764824 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:45.772673 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e10bf8cf-3f4d-4597-b7fe-bd28b1253cfa tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.154419 Mar 02 03:39:45.773241 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 207/392] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:45 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:46.789533 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:46.790263 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:46.796504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:46.796952 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:46.797725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:46.798160 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:46.928948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:46.936788 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-034bf2a7-3a1b-4400-911d-6b0524b2e638 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.151096 Mar 02 03:39:46.937350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 186/393] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:46 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:47.954952 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:47.955638 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:47.961923 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:47.962379 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:47.963214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:47.963658 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:48.099417 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:48.107849 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-189ede37-0661-4ba6-80f4-85077819148c tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.156987 Mar 02 03:39:48.108409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 208/394] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:47 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:49.124773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:49.125379 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:49.131688 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:49.132133 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:49.132898 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:49.133851 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:49.264545 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:49.272183 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1c3e3364-ca7b-4669-a977-f4862f14966e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.151384 Mar 02 03:39:49.272732 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 187/395] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:49 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:50.289026 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:50.290556 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:50.296938 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:50.297383 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:50.298153 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:50.298583 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:50.429319 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:50.437673 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f4bb6c20-ab2a-4e71-9415-d145b5b2e9f5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.152464 Mar 02 03:39:50.438236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 209/396] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:50 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:51.455380 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:51.455985 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:51.462728 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:51.463204 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:51.464109 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:51.464631 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:51.597840 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:51.605684 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-46a65f27-677c-4523-8f74-836b2afc5345 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.154514 Mar 02 03:39:51.606242 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 188/397] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:51 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:52.622637 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:52.623170 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:52.629358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:52.629808 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:52.630572 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:52.631006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:52.762785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:52.770575 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-082e8741-eb30-4eed-a4b6-ac0539f457ab tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.151909 Mar 02 03:39:52.771161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 210/398] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:52 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:53.788831 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:53.790123 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:53.796703 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:53.797156 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:53.797958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:53.798463 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:53.965991 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:53.974587 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-53371517-224d-4560-9769-35eda36d5ce3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.189607 Mar 02 03:39:53.975191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 189/399] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:53 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:54.991975 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:54.993159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:54.999352 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:54.999796 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:55.000562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:55.000994 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:55.072098 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:55.072670 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:55.079205 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:55.079594 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:55.080376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:55.080809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:55.137635 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:55.145326 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-630f7802-cfd4-44a7-9caa-89c54bca909f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1567 microversion: 2.1 time: 0.157233 Mar 02 03:39:55.145965 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 211/400] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:54 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:55.157929 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lazy-loading 'services' on Instance uuid ee4cc78a-0eee-414f-b94c-ce46d164cbd9 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:39:55.226574 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4c5bdda9-8230-415f-8bb7-393064928ca7 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9/os-volume_attachments/d9946598-a7be-4283-8bc3-abdb276dc6ce" status: 202 len: 0 microversion: 2.1 time: 0.158526 Mar 02 03:39:55.227809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 190/401] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:39:55 2022] DELETE /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9/os-volume_attachments/d9946598-a7be-4283-8bc3-abdb276dc6ce => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:39:56.161633 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:56.162295 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:56.168574 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.169031 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.169819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.170260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.303479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:56.314030 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b8bb41ec-3721-49a5-84ba-e9f494c186a5 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1547 microversion: 2.1 time: 0.156235 Mar 02 03:39:56.314602 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 212/402] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:56 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:56.332191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:56.332770 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:56.339097 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.339546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.340602 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.340986 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.420977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] HTTP exception thrown: Cannot 'detach_volume' instance 3a6146a9-fa07-430b-97f6-0e4174847543 while it is in vm_state rescued Mar 02 03:39:56.421571 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Returning 409 to user: Cannot 'detach_volume' instance 3a6146a9-fa07-430b-97f6-0e4174847543 while it is in vm_state rescued {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:39:56.422411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-247441a6-0577-4cf6-ac7d-c4cec96a3583 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments/9c4327a6-9a18-4585-99fc-2badbdf4b43a" status: 409 len: 152 microversion: 2.1 time: 0.095383 Mar 02 03:39:56.422954 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 191/403] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:39:56 2022] DELETE /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments/9c4327a6-9a18-4585-99fc-2badbdf4b43a => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 02 03:39:56.432514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-04bc8a16-1f72-4505-bf0c-b268542fcffb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:39:56.433057 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-04bc8a16-1f72-4505-bf0c-b268542fcffb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:56.439035 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04bc8a16-1f72-4505-bf0c-b268542fcffb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.439532 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04bc8a16-1f72-4505-bf0c-b268542fcffb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.440941 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04bc8a16-1f72-4505-bf0c-b268542fcffb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.441560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-04bc8a16-1f72-4505-bf0c-b268542fcffb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.507884 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-04bc8a16-1f72-4505-bf0c-b268542fcffb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action" status: 202 len: 0 microversion: 2.1 time: 0.080196 Mar 02 03:39:56.511715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 213/404] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:39:56 2022] POST /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:39:56.516743 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:56.517347 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:56.523135 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.523567 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.524341 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:56.524791 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:56.655918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:56.663709 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0f9b9cf8-fd2b-4d96-9c6a-9bc9deb3e72b tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1555 microversion: 2.1 time: 0.150765 Mar 02 03:39:56.665327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 192/405] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:56 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:39:57.389326 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:57.390051 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:57.396182 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:57.396626 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:57.397517 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:57.397950 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:57.421983 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:39:57.492738 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2e3c259b-f196-4974-b0e6-88ec77a18258 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 204 len: 0 microversion: 2.1 time: 0.108968 Mar 02 03:39:57.493449 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 214/406] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:39:57 2022] DELETE /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:39:57.502454 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:57.503076 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:57.509832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:57.510272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:57.511034 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:57.511490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:57.645107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:57.652834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1ef324dc-2052-4a4f-9fe1-0a93a000ab15 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1514 microversion: 2.1 time: 0.154808 Mar 02 03:39:57.653395 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 193/407] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:57 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:57.683075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:57.683783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:57.689804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:57.690253 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:57.691028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:57.691512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:57.833393 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:57.841389 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-17108caa-8e4c-48f4-8287-cc606113b4ae tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1555 microversion: 2.1 time: 0.163314 Mar 02 03:39:57.841945 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 215/408] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:57 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:58.670412 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:58.671077 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:58.677243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:58.677704 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:58.678448 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:58.678876 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:58.812072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:58.819333 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4846fabf-4f05-4328-b81f-cb8cf3d6fd1b tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1514 microversion: 2.1 time: 0.152874 Mar 02 03:39:58.819887 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 194/409] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:58 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:58.858913 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:58.859557 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:58.865725 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:58.866172 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:58.866935 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:58.868048 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:58.998950 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:59.006841 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4923c92a-ad10-4eba-a5ce-6fa1f32e57e3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1555 microversion: 2.1 time: 0.151777 Mar 02 03:39:59.007475 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 216/410] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:58 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:39:59.837476 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:39:59.838086 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:39:59.844328 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:59.844777 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:59.845550 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:39:59.845981 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:39:59.976112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:39:59.984603 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d4fece57-2968-4aa1-ab9f-985d2a400407 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1514 microversion: 2.1 time: 0.151951 Mar 02 03:39:59.985185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 195/411] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:39:59 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:00.024634 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:00.025350 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:00.031734 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:00.032269 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:00.033047 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:00.033481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:00.252867 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:00.261822 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1092b0dc-1bcc-4bff-9657-f2680ddc9892 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1561 microversion: 2.1 time: 0.241730 Mar 02 03:40:00.262400 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 217/412] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:00 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:00.328486 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:00.328978 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:00.334659 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:00.335135 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:00.335992 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:00.336948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:00.418072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lazy-loading 'services' on Instance uuid 3a6146a9-fa07-430b-97f6-0e4174847543 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:40:00.495806 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-06be35d8-1b95-48ee-b57a-cbef650f7837 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments/9c4327a6-9a18-4585-99fc-2badbdf4b43a" status: 202 len: 0 microversion: 2.1 time: 0.171524 Mar 02 03:40:00.496390 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 196/413] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:40:00 2022] DELETE /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments/9c4327a6-9a18-4585-99fc-2badbdf4b43a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:40:00.505322 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0a4b1cfb-2a25-4995-97f0-16dea68a1f0d tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:00.506524 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0a4b1cfb-2a25-4995-97f0-16dea68a1f0d tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:00.515613 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a4b1cfb-2a25-4995-97f0-16dea68a1f0d tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:00.516372 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a4b1cfb-2a25-4995-97f0-16dea68a1f0d tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:00.517433 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a4b1cfb-2a25-4995-97f0-16dea68a1f0d tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:00.517865 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a4b1cfb-2a25-4995-97f0-16dea68a1f0d tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:00.532871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-89b5a115-7633-4da3-999f-1695559db693 req-89b60f2a-30fd-4afc-8c44-bb03ab48bca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cc78a-0eee-414f-b94c-ce46d164cbd9", "name": "network-vif-deleted", "tag": "0c2e3082-1fd0-46cf-943c-d66856ae42a9"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:00.541947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-89b5a115-7633-4da3-999f-1695559db693 req-89b60f2a-30fd-4afc-8c44-bb03ab48bca4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:00.542393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-89b5a115-7633-4da3-999f-1695559db693 req-89b60f2a-30fd-4afc-8c44-bb03ab48bca4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:00.550856 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0a4b1cfb-2a25-4995-97f0-16dea68a1f0d tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049822 Mar 02 03:40:00.552181 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 218/414] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:40:00 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:00.558028 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-89b5a115-7633-4da3-999f-1695559db693 req-89b60f2a-30fd-4afc-8c44-bb03ab48bca4 service nova] Creating event network-vif-deleted:0c2e3082-1fd0-46cf-943c-d66856ae42a9 for instance ee4cc78a-0eee-414f-b94c-ce46d164cbd9 on hv-cinder-83109 Mar 02 03:40:00.562595 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-89b5a115-7633-4da3-999f-1695559db693 req-89b60f2a-30fd-4afc-8c44-bb03ab48bca4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033861 Mar 02 03:40:00.563197 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 197/415] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:01.001563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:01.002202 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:01.008531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:01.008980 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:01.009743 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:01.010178 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:01.039757 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:01.040378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:01.040644 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lazy-loading 'fault' on Instance uuid ee4cc78a-0eee-414f-b94c-ce46d164cbd9 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:40:01.079500 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e1eaabbfa482b8897bca1ce980893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dac378b4f74c5d972b52cde9208383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:01.087274 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-812bcbdb-04bc-407f-b2ba-a433096ba26c tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 200 len: 1309 microversion: 2.1 time: 0.089470 Mar 02 03:40:01.087838 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 219/416] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:00 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:01.564433 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a6666963-2d4b-4bf0-9a93-47fec086ddcd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:01.565497 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a6666963-2d4b-4bf0-9a93-47fec086ddcd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:01.571940 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a6666963-2d4b-4bf0-9a93-47fec086ddcd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:01.572383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a6666963-2d4b-4bf0-9a93-47fec086ddcd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:01.573143 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a6666963-2d4b-4bf0-9a93-47fec086ddcd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:01.573629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a6666963-2d4b-4bf0-9a93-47fec086ddcd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:01.602477 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a6666963-2d4b-4bf0-9a93-47fec086ddcd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042582 Mar 02 03:40:01.603018 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 198/417] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:40:01 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:02.104271 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:02.104788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] [instance: ee4cc78a-0eee-414f-b94c-ce46d164cbd9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:02.110976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:02.111478 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:02.112306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:02.112739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:02.126233 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] HTTP exception thrown: Instance ee4cc78a-0eee-414f-b94c-ce46d164cbd9 could not be found. Mar 02 03:40:02.126814 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] Returning 404 to user: Instance ee4cc78a-0eee-414f-b94c-ce46d164cbd9 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:40:02.127647 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-40d52e0d-c05c-482a-9343-a88025a711d1 tempest-VolumesSnapshotTestJSON-1597627660 tempest-VolumesSnapshotTestJSON-1597627660-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9" status: 404 len: 111 microversion: 2.1 time: 0.027571 Mar 02 03:40:02.128162 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 220/418] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:02 2022] GET /compute/v2.1/servers/ee4cc78a-0eee-414f-b94c-ce46d164cbd9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:40:02.613995 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-18481f98-306f-4260-8028-388dd9e0a664 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:02.614822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-18481f98-306f-4260-8028-388dd9e0a664 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:02.622002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-18481f98-306f-4260-8028-388dd9e0a664 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:02.622460 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-18481f98-306f-4260-8028-388dd9e0a664 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:02.623269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-18481f98-306f-4260-8028-388dd9e0a664 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:02.623713 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-18481f98-306f-4260-8028-388dd9e0a664 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:02.650245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-18481f98-306f-4260-8028-388dd9e0a664 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040337 Mar 02 03:40:02.650797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 199/419] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:40:02 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:40:07.054114 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:07.054620 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:07.061664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:07.062119 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:07.062919 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:07.063422 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:07.087885 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:40:07.158688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c43a58e3-a419-4faa-a9ea-8f93828c0070 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 204 len: 0 microversion: 2.1 time: 0.108246 Mar 02 03:40:07.159217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 221/420] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:40:07 2022] DELETE /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:40:07.168034 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:07.168669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:07.175272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:07.175729 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:07.176517 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:07.176950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:07.314738 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:07.322617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9ea7d18d-f551-482f-a438-fdfde673a0b2 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1509 microversion: 2.1 time: 0.159285 Mar 02 03:40:07.323267 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 200/421] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:07 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:08.341308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:08.341918 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:08.348109 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:08.348557 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:08.349325 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:08.349760 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:08.491274 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:08.499298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-54834939-e2d6-4752-97ba-9b1cd4158731 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1509 microversion: 2.1 time: 0.162827 Mar 02 03:40:08.499955 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 222/422] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:08 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:09.516912 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:09.517515 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:09.523732 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:09.524176 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:09.525597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:09.526033 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:09.660817 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:09.668814 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-df445ca7-6a18-4b65-948b-8811b98b141f tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1509 microversion: 2.1 time: 0.155763 Mar 02 03:40:09.669378 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 201/423] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:09 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:10.686722 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:10.687369 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:10.693619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:10.694074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:10.694846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:10.695307 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:10.914682 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:10.922005 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1356ebec-90d0-434b-93b7-8bc4aabb0363 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1509 microversion: 2.1 time: 0.239171 Mar 02 03:40:10.922567 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 223/424] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:10 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:11.080107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-153a7d6b-a49f-454a-898a-555077a0bedb req-e461df46-ee32-4d4c-add7-623e7870acd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1154afc0-676f-4f85-94fe-a605573997b5", "name": "network-vif-deleted", "tag": "4adb2ae7-9d65-494f-ac1f-d825bc2a9d49"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:11.089915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-153a7d6b-a49f-454a-898a-555077a0bedb req-e461df46-ee32-4d4c-add7-623e7870acd4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:11.090353 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-153a7d6b-a49f-454a-898a-555077a0bedb req-e461df46-ee32-4d4c-add7-623e7870acd4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:11.100853 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-153a7d6b-a49f-454a-898a-555077a0bedb req-e461df46-ee32-4d4c-add7-623e7870acd4 service nova] Creating event network-vif-deleted:4adb2ae7-9d65-494f-ac1f-d825bc2a9d49 for instance 1154afc0-676f-4f85-94fe-a605573997b5 on hv-cinder-83109 Mar 02 03:40:11.105823 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-153a7d6b-a49f-454a-898a-555077a0bedb req-e461df46-ee32-4d4c-add7-623e7870acd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029601 Mar 02 03:40:11.106392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 202/425] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:11.116164 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a94bcc09-9b36-4dfe-a6cc-aebd85cf13ed tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:11.117155 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a94bcc09-9b36-4dfe-a6cc-aebd85cf13ed tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:11.123729 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a94bcc09-9b36-4dfe-a6cc-aebd85cf13ed tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:11.124173 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a94bcc09-9b36-4dfe-a6cc-aebd85cf13ed tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:11.124944 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a94bcc09-9b36-4dfe-a6cc-aebd85cf13ed tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:11.125378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a94bcc09-9b36-4dfe-a6cc-aebd85cf13ed tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:11.192352 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a94bcc09-9b36-4dfe-a6cc-aebd85cf13ed tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/action" status: 202 len: 0 microversion: 2.1 time: 0.079938 Mar 02 03:40:11.193076 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 224/426] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:40:11 2022] POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:40:11.201833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:11.202774 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:11.208819 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:11.209263 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:11.210026 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:11.210457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:11.354023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:11.361602 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0b9cc8c1-fecb-4323-8d75-433bad6c8fd9 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1751 microversion: 2.1 time: 0.163930 Mar 02 03:40:11.362157 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 203/427] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:11 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:11.940284 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:11.940987 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:11.947678 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:11.948131 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:11.948917 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:11.949357 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:12.010734 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:12.018036 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-77f4c60c-30b4-4cfc-b4bb-97c1cd1ab724 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1467 microversion: 2.1 time: 0.082463 Mar 02 03:40:12.018623 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 225/428] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:11 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1467 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:12.378774 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:12.379412 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:12.385860 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:12.386308 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:12.387102 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:12.387542 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:12.532952 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:12.541245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-73c11b9a-3a4c-4aef-bbc9-ab396a62cb1a tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1751 microversion: 2.1 time: 0.166323 Mar 02 03:40:12.541808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 204/429] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:12 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:13.034058 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:13.034660 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:13.041787 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:13.042233 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:13.043017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:13.043481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:13.103306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:13.110525 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e1697652-5d45-4455-a198-7c86c6a8ff83 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1293 microversion: 2.1 time: 0.080332 Mar 02 03:40:13.111100 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 226/430] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:13 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:13.558624 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:13.559611 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:13.565882 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:13.566325 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:13.567122 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:13.567553 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:13.713032 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:13.721986 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-93256020-1610-43ba-be5f-e013d90a5953 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1751 microversion: 2.1 time: 0.168059 Mar 02 03:40:13.723199 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 205/431] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:13 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:14.016951 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a192a68a-cf6b-4399-8b02-176ca4cb2bb2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:14.017871 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a192a68a-cf6b-4399-8b02-176ca4cb2bb2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:14.024763 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a192a68a-cf6b-4399-8b02-176ca4cb2bb2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.025228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a192a68a-cf6b-4399-8b02-176ca4cb2bb2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.026022 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a192a68a-cf6b-4399-8b02-176ca4cb2bb2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.026511 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a192a68a-cf6b-4399-8b02-176ca4cb2bb2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.055177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a192a68a-cf6b-4399-8b02-176ca4cb2bb2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046185 Mar 02 03:40:14.055907 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 227/432] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:40:14 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:40:14.113778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:14.114282 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:14.121187 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.121855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.122643 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.123276 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.126466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:14.127914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:14.133971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.134618 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.135452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.135892 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.148229 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:40:14.168042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.168505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.168956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lazy-loading 'fault' on Instance uuid 1154afc0-676f-4f85-94fe-a605573997b5 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:40:14.237250 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:14.241217 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8d8eed6a-4de4-4252-bd5d-d4e040782062 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 204 len: 0 microversion: 2.1 time: 0.130903 Mar 02 03:40:14.241989 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 206/433] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:40:14 2022] DELETE /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:40:14.247210 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6ea3ed51-4014-4ace-9105-0971e3975be4 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 200 len: 1312 microversion: 2.1 time: 0.124748 Mar 02 03:40:14.248605 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 228/434] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:14 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:14.252002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:14.252706 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:14.259519 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.260136 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.260938 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.261406 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.502564 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:14.510040 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8e64c8f0-344f-48c8-ad6d-c74b4296c068 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1674 microversion: 2.1 time: 0.262723 Mar 02 03:40:14.510604 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 207/435] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:14 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1674 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:14.743486 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:14.744404 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:14.753416 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.753876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.754726 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:14.755429 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:14.912327 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:14.920629 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-09912d82-e318-4619-8d89-abb7d3695da7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.184901 Mar 02 03:40:14.921190 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 229/436] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:14 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:15.265754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:15.266371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 1154afc0-676f-4f85-94fe-a605573997b5] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:15.273214 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.273667 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.275175 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.275634 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.288504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] HTTP exception thrown: Instance 1154afc0-676f-4f85-94fe-a605573997b5 could not be found. Mar 02 03:40:15.289084 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Returning 404 to user: Instance 1154afc0-676f-4f85-94fe-a605573997b5 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:40:15.290108 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9b984c15-e76e-48a2-b34d-b428d5710efd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5" status: 404 len: 111 microversion: 2.1 time: 0.028382 Mar 02 03:40:15.290644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 208/437] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:15 2022] GET /compute/v2.1/servers/1154afc0-676f-4f85-94fe-a605573997b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:40:15.298659 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:15.299202 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:15.305536 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.305990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.306761 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.307284 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.332671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:40:15.405346 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b03969a4-410c-4e16-9c18-8cc50f4a6af3 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 204 len: 0 microversion: 2.1 time: 0.110231 Mar 02 03:40:15.405940 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 230/438] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:40:15 2022] DELETE /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:40:15.415770 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:15.416387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:15.422675 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.423153 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.423931 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.424371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.527557 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:15.528206 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:15.534660 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.535139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.536154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.536793 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.559807 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:15.567487 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bdd6efd8-666f-472f-b8e2-f915b1c199fb tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.157237 Mar 02 03:40:15.568064 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 209/439] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:15 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:15.669392 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:15.676648 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-648523bf-9eac-4871-8665-35d0a9b8e46f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1674 microversion: 2.1 time: 0.153723 Mar 02 03:40:15.677212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 231/440] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:15 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:15.937326 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:15.937928 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:15.943746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.944188 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:15.944995 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:15.945424 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:16.086827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:16.094442 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a8f74a9f-09ff-4e6c-8e34-e4751ee5cd89 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.160933 Mar 02 03:40:16.094993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 210/441] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:15 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:16.586227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:16.587632 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:16.593779 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:16.594235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:16.595014 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:16.595479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:16.694340 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:16.694980 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:16.702101 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:16.702551 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:16.703363 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:16.703798 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:16.731636 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:16.739150 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-61820e4e-a8af-4a22-9b58-521b6d586587 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.157056 Mar 02 03:40:16.739726 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 232/442] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:16 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:16.834697 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:16.842882 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f0e41dcc-d4d6-478a-9f4b-33654fc2f890 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1674 microversion: 2.1 time: 0.152274 Mar 02 03:40:16.843458 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 211/443] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:16 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:17.111581 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:17.112111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:17.117929 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:17.118396 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:17.119728 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:17.120238 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:17.264697 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:17.272564 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f52a9d22-bb3c-4f90-b60d-79e15a6a8c3b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.164951 Mar 02 03:40:17.273119 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 233/444] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:17 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:17.756358 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:17.756989 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:17.763897 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:17.764350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:17.765149 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:17.765622 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:17.860523 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:17.861140 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:17.867683 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:17.868138 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:17.869260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:17.869714 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:18.215809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:18.222870 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-268867c2-3683-411d-ad8c-c4fc77dd5abd tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.470476 Mar 02 03:40:18.223462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 212/445] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:17 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:18.231124 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:18.238472 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-44242976-34f0-4a3d-98d5-1b3676e7f709 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1674 microversion: 2.1 time: 0.381778 Mar 02 03:40:18.239137 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 234/446] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:17 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1674 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:18.290081 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:18.290954 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:18.296841 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:18.297364 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:18.298236 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:18.298715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:18.591966 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:18.599665 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6e545178-4898-4d5e-99f7-4a0d9d4a6b66 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.313349 Mar 02 03:40:18.600234 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 213/447] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:18 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:18.713779 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-0f4fd4c7-b083-4e90-8585-a88ebfcd5181 req-a7cff77d-713b-45b6-8940-e6073100c099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4602d0-7bdf-4d87-a748-e9b324e1a566", "name": "network-vif-deleted", "tag": "10447e32-8d88-44df-9480-8b3b38b17f4e"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:18.723696 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-0f4fd4c7-b083-4e90-8585-a88ebfcd5181 req-a7cff77d-713b-45b6-8940-e6073100c099 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:18.724150 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-0f4fd4c7-b083-4e90-8585-a88ebfcd5181 req-a7cff77d-713b-45b6-8940-e6073100c099 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:18.746848 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-0f4fd4c7-b083-4e90-8585-a88ebfcd5181 req-a7cff77d-713b-45b6-8940-e6073100c099 service nova] Creating event network-vif-deleted:10447e32-8d88-44df-9480-8b3b38b17f4e for instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 on hv-cinder-83109 Mar 02 03:40:18.752123 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-0f4fd4c7-b083-4e90-8585-a88ebfcd5181 req-a7cff77d-713b-45b6-8940-e6073100c099 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043243 Mar 02 03:40:18.752713 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 235/448] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:19.241150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:19.241750 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:19.249935 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:19.250393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:19.252434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:19.252876 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:19.258332 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:19.259691 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:19.267922 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:19.270032 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:19.270867 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:19.271345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:19.314823 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:19.315309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:19.315772 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lazy-loading 'fault' on Instance uuid 1e4602d0-7bdf-4d87-a748-e9b324e1a566 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:40:19.374531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:19.385308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-014691a3-0083-4f3f-a0a7-a086880d7b6b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 200 len: 1327 microversion: 2.1 time: 0.130400 Mar 02 03:40:19.390380 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 236/449] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:19 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:19.444222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:19.452099 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1777e81d-7136-4bc4-ab1c-39bcd1e5688e tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.215709 Mar 02 03:40:19.452685 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 214/450] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:19 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:19.619458 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:19.621380 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:19.638512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:19.638988 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:19.639868 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:19.640308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:19.800147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:19.808969 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-81c4dfcc-067a-42dc-940b-621925174d68 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.194842 Mar 02 03:40:19.809595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 237/451] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:19 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:20.406124 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:20.406707 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:20.412891 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:20.413341 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:20.414109 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:20.414537 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:20.427740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] HTTP exception thrown: Instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 could not be found. Mar 02 03:40:20.428322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Returning 404 to user: Instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:40:20.429133 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-222bb22c-b686-48f3-a9b9-27f13ded43c3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 404 len: 111 microversion: 2.1 time: 0.027073 Mar 02 03:40:20.429665 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 215/452] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:20 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:40:20.438727 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fda8cc58-83b8-4126-b0fd-65433ff0d44c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '.version_select at 0x7fc37fc28430>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:20.457405 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fda8cc58-83b8-4126-b0fd-65433ff0d44c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678821105" status: 202 len: 0 microversion: 2.1 time: 0.022365 Mar 02 03:40:20.457979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 238/453] 10.222.0.23 () {58 vars in 1220 bytes} [Wed Mar 2 03:40:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678821105 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:40:20.469977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:20.470281 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:20.476387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:20.476888 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:20.478258 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:20.479041 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:20.671581 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:20.682995 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-649a0b73-53e9-4b33-9c81-b159a57a1683 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.214054 Mar 02 03:40:20.687559 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 216/454] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:20 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:20.828311 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:20.829353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:20.836037 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:20.836532 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:20.837393 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:20.838153 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:21.120102 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:21.129696 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d1121b22-efc5-4f63-b897-6f60a7f7c325 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.305483 Mar 02 03:40:21.132095 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 239/455] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:20 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:21.328169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c34fd578-a2d3-4bcd-ac31-97c508fc5c6e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'create', calling method: .version_select at 0x7fc38c6ad670>, body: {"keypair": {"name": "tempest-keypair-661807575"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:21.346345 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-c34fd578-a2d3-4bcd-ac31-97c508fc5c6e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:40:21.350040 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-c34fd578-a2d3-4bcd-ac31-97c508fc5c6e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for user b101d4fa905743eb944d80e401ee5768 and project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:40:21.696934 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:21.697541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:21.704051 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:21.704512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:21.705293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:21.705738 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:21.790827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-c34fd578-a2d3-4bcd-ac31-97c508fc5c6e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:40:21.794724 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-c34fd578-a2d3-4bcd-ac31-97c508fc5c6e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for user b101d4fa905743eb944d80e401ee5768 and project e7eaffa6e46a4505b1573a455ec97201. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:40:21.807684 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c34fd578-a2d3-4bcd-ac31-97c508fc5c6e tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.483625 Mar 02 03:40:21.808277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 217/456] 10.222.0.23 () {60 vars in 1157 bytes} [Wed Mar 2 03:40:21 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:21.848372 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:21.856750 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9d73f324-5dd2-4599-b789-895d2f69e4ec tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1521 microversion: 2.1 time: 0.163744 Mar 02 03:40:21.857662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 240/457] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:21 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:22.148333 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:22.149561 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:22.160721 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:22.161467 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:22.162409 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:22.164013 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:22.427437 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:22.438593 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-26812ad9-6858-4ddf-996d-b9c334e14416 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.293524 Mar 02 03:40:22.439672 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 218/458] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:22 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:22.702739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-d813dfe7-98f5-4a06-b0ff-7cdcc17ef919 req-1fcc3961-37fb-41c9-bac5-338f6816c7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6146a9-fa07-430b-97f6-0e4174847543", "name": "network-vif-deleted", "tag": "14e262d3-569e-4b08-8103-f41c4635b575"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:22.712852 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-d813dfe7-98f5-4a06-b0ff-7cdcc17ef919 req-1fcc3961-37fb-41c9-bac5-338f6816c7b7 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:22.713572 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-d813dfe7-98f5-4a06-b0ff-7cdcc17ef919 req-1fcc3961-37fb-41c9-bac5-338f6816c7b7 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:22.724877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-d813dfe7-98f5-4a06-b0ff-7cdcc17ef919 req-1fcc3961-37fb-41c9-bac5-338f6816c7b7 service nova] Creating event network-vif-deleted:14e262d3-569e-4b08-8103-f41c4635b575 for instance 3a6146a9-fa07-430b-97f6-0e4174847543 on hv-cinder-83109 Mar 02 03:40:22.731386 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-d813dfe7-98f5-4a06-b0ff-7cdcc17ef919 req-1fcc3961-37fb-41c9-bac5-338f6816c7b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032341 Mar 02 03:40:22.732556 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 241/459] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:22.874252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:22.875000 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:22.881709 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:22.882158 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:22.882940 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:22.883722 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:22.913497 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:22.913948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:22.914399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lazy-loading 'fault' on Instance uuid 3a6146a9-fa07-430b-97f6-0e4174847543 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:40:22.957597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf8e657ca8946a7afdd007c82eddebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f89629bbd3430a8609e478eef5895b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:22.965968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-43bc887c-998f-484c-9468-5803f834f754 tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 200 len: 1311 microversion: 2.1 time: 0.095640 Mar 02 03:40:22.966547 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 219/460] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:22 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:23.187357 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-436970872", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2b3d2cd-489e-4454-8144-25e2fab88e9d"}], "security_groups": [{"name": "tempest-securitygroup--1373748180"}], "key_name": "tempest-keypair-661807575", "user_data": "}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:23.301510 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] validate_networks() for [('f2b3d2cd-489e-4454-8144-25e2fab88e9d', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:40:23.456748 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:23.457389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:23.463970 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:23.464420 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:23.465213 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:23.465755 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:23.728438 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:23.738138 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3eea38b9-14dd-44db-a64a-3033d3345c0b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.285392 Mar 02 03:40:23.738710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 220/461] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:23 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:23.752945 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:40:23.753447 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:40:23.753858 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:40:23.754268 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:40:23.754679 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:40:23.764045 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:23.764500 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:23.765316 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:23.765790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:23.782557 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for project e7eaffa6e46a4505b1573a455ec97201. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:40:23.786429 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Getting quotas for user b101d4fa905743eb944d80e401ee5768 and project e7eaffa6e46a4505b1573a455ec97201. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:40:23.797610 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:40:23.800008 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:40:23.844488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-820feac1-9560-49fe-8ef1-7836bf89b146 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662183 Mar 02 03:40:23.845129 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 242/462] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:40:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:40:23.855150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-27f22781-ddc6-4dc7-999e-1ba2e40e9644 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:23.855851 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-27f22781-ddc6-4dc7-999e-1ba2e40e9644 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:23.912672 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-27f22781-ddc6-4dc7-999e-1ba2e40e9644 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:23.919827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-27f22781-ddc6-4dc7-999e-1ba2e40e9644 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1236 microversion: 2.1 time: 0.068547 Mar 02 03:40:23.920656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 221/463] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:23 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:23.982509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:23.983149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] [instance: 3a6146a9-fa07-430b-97f6-0e4174847543] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:23.989912 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:23.990515 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:23.991535 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:23.991785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:24.005431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] HTTP exception thrown: Instance 3a6146a9-fa07-430b-97f6-0e4174847543 could not be found. Mar 02 03:40:24.006027 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] Returning 404 to user: Instance 3a6146a9-fa07-430b-97f6-0e4174847543 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:40:24.006851 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e6712a93-88fc-4d31-934c-7be90254a1cc tempest-ServerRescueNegativeTestJSON-1477620040 tempest-ServerRescueNegativeTestJSON-1477620040-project] 10.222.0.23 "GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543" status: 404 len: 111 microversion: 2.1 time: 0.028833 Mar 02 03:40:24.007427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 243/464] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:23 2022] GET /compute/v2.1/servers/3a6146a9-fa07-430b-97f6-0e4174847543 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:40:24.758185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:24.759656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:24.781191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:24.781976 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:24.782829 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:24.783479 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:24.937243 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:24.937841 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:24.944520 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:24.945268 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:24.946795 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:24.947499 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:25.039816 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:25.046783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-87d9ec99-70bf-4e9b-881a-d8253066da25 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1306 microversion: 2.1 time: 0.113457 Mar 02 03:40:25.047376 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 244/465] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:24 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1306 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:25.234381 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:25.242289 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-68b1b4de-e8ac-4d6d-b892-112f8c7ca7b7 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.487913 Mar 02 03:40:25.242850 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 222/466] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:24 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:26.063877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:26.064418 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:26.070884 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:26.071599 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:26.072406 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:26.072855 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:26.260918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:26.261628 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:26.297208 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:26.301681 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:26.302516 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:26.302960 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:26.510838 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:26.518075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8762c4d0-8f6a-4f9b-9bc9-60092e660a57 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.458294 Mar 02 03:40:26.527246 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 245/467] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:26 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:26.972999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:26.980917 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-99ae4bbd-060e-4224-b09b-f714122730d1 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.724716 Mar 02 03:40:26.981978 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 223/468] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:26 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:27.536936 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:27.537974 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:27.548619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:27.549414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:27.552323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:27.553115 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:27.720476 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-eb8d38a4-322a-45e4-894c-b6a638d406d4 req-b467ee7e-e9a6-4f51-879c-beebc0cf2a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6728102-8a08-438b-bda8-7d8198949d16", "tag": "ae2d5a72-79a7-4805-8ddb-58e051540660"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:27.732084 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-eb8d38a4-322a-45e4-894c-b6a638d406d4 req-b467ee7e-e9a6-4f51-879c-beebc0cf2a3e service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:27.740979 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-eb8d38a4-322a-45e4-894c-b6a638d406d4 req-b467ee7e-e9a6-4f51-879c-beebc0cf2a3e service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:27.771191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-eb8d38a4-322a-45e4-894c-b6a638d406d4 req-b467ee7e-e9a6-4f51-879c-beebc0cf2a3e service nova] Creating event network-changed:ae2d5a72-79a7-4805-8ddb-58e051540660 for instance c6728102-8a08-438b-bda8-7d8198949d16 on hv-cinder-83109 Mar 02 03:40:27.782593 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-eb8d38a4-322a-45e4-894c-b6a638d406d4 req-b467ee7e-e9a6-4f51-879c-beebc0cf2a3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065614 Mar 02 03:40:27.783230 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 224/469] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:40:27.911511 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:27.925131 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a4b023f1-5aaf-4da1-bb6f-1004774a53b7 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.393182 Mar 02 03:40:27.925720 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 246/470] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:27 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:27.999926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:28.000641 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:28.019652 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:28.020665 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:28.022156 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:28.022747 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:28.288839 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:28.299357 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-958663d3-30e3-4d02-934a-be62c4c9d2c2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.303608 Mar 02 03:40:28.300282 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 225/471] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:27 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:28.941877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:28.942485 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:28.950105 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:28.950562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:28.951721 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:28.952235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:29.090903 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:29.098082 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c2483926-0fd9-4be9-a863-c5f548e90f4b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.160089 Mar 02 03:40:29.098639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 247/472] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:28 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:29.316744 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:29.317462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:29.323957 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:29.324403 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:29.325177 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:29.325606 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:29.472386 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:29.481134 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-db67f46d-d882-4587-9cc3-29cb8df8274b tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.168275 Mar 02 03:40:29.481698 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 226/473] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:29 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:30.116523 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:30.117261 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:30.124216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:30.124671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:30.125465 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:30.125900 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:30.296823 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:30.305209 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3c922a0f-4439-4674-ad14-b24e7adece86 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.193263 Mar 02 03:40:30.305789 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 248/474] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:30 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:30.498840 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:30.499472 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:30.506124 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:30.506736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:30.507559 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:30.508398 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:30.683904 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:30.692107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e267db90-c58f-42c4-80c2-0b4caf11dd93 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1756 microversion: 2.1 time: 0.197446 Mar 02 03:40:30.692528 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 227/475] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:30 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:31.327943 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:31.329106 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:31.337532 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:31.338196 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:31.339191 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:31.339816 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:31.599759 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:31.622439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6b1fbfe4-e0b2-4b87-b503-715fd53c9085 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.299857 Mar 02 03:40:31.625745 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 249/476] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:31 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:31.709715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:31.710326 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:31.716868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:31.717554 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:31.718338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:31.718770 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:31.896709 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:31.905964 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7e196634-1e25-481e-be06-9e841e21f84e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1759 microversion: 2.1 time: 0.200067 Mar 02 03:40:31.907091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 228/477] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:31 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1759 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:32.640431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:32.641249 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:32.647828 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:32.648358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:32.649758 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:32.650621 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:32.848060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:32.857566 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2ba75064-7439-47a2-a8a9-3a8d92ec1030 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.221002 Mar 02 03:40:32.866970 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 250/478] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:32 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:33.873898 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:33.875155 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:33.884564 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:33.885512 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:33.886488 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:33.887289 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:34.111834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:34.140526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bbb3cdba-8553-4e43-912a-43ffffbfdbe9 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.269724 Mar 02 03:40:34.142579 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 229/479] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:33 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:34.800016 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f9febfad-7cd6-4bd3-801d-6dcc6da6497d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'create', calling method: .version_select at 0x7fc37fc34280>, body: {"keypair": {"name": "tempest-keypair-1997801100"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:34.814232 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-f9febfad-7cd6-4bd3-801d-6dcc6da6497d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:40:34.818385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-f9febfad-7cd6-4bd3-801d-6dcc6da6497d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for user c3aa2415a0a1430686ee1e519c02bef0 and project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:40:35.138635 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-f9febfad-7cd6-4bd3-801d-6dcc6da6497d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:40:35.142602 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-f9febfad-7cd6-4bd3-801d-6dcc6da6497d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for user c3aa2415a0a1430686ee1e519c02bef0 and project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:40:35.156818 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f9febfad-7cd6-4bd3-801d-6dcc6da6497d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.643806 Mar 02 03:40:35.158896 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 251/480] 10.222.0.23 () {62 vars in 1198 bytes} [Wed Mar 2 03:40:34 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 645 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 02 03:40:35.159373 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:35.160083 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:35.168111 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:35.168814 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:35.169617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:35.170055 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:35.354428 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:35.365871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-305fcff9-024b-413e-a538-b62263cfa9ed tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.210863 Mar 02 03:40:35.366678 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 230/481] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:35 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:36.383985 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:36.384787 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:36.393025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:36.393562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:36.394441 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:36.394945 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:36.541452 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-153974811", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32368c2c-db5f-4ddd-a790-805e54143545"}], "security_groups": [{"name": "tempest-securitygroup--1035934099"}], "key_name": "tempest-keypair-1997801100", "user_data": "}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:36.559191 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:36.569681 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f8d0d922-2b76-4f9a-8f9b-b685627e4506 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.190246 Mar 02 03:40:36.571447 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 252/482] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:36 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:36.643396 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] validate_networks() for [('32368c2c-db5f-4ddd-a790-805e54143545', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:40:37.016452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-858b9073-87a2-4e21-8e73-cd487f793577 req-0710c69b-ef1f-4198-acf1-eda47121905f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6728102-8a08-438b-bda8-7d8198949d16", "name": "network-vif-plugged", "status": "completed", "tag": "ae2d5a72-79a7-4805-8ddb-58e051540660"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:37.034569 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-858b9073-87a2-4e21-8e73-cd487f793577 req-0710c69b-ef1f-4198-acf1-eda47121905f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:37.035523 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-858b9073-87a2-4e21-8e73-cd487f793577 req-0710c69b-ef1f-4198-acf1-eda47121905f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:37.048436 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:40:37.048868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:40:37.049342 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:40:37.049749 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:40:37.050161 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:40:37.057793 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-858b9073-87a2-4e21-8e73-cd487f793577 req-0710c69b-ef1f-4198-acf1-eda47121905f service nova] Creating event network-vif-plugged:ae2d5a72-79a7-4805-8ddb-58e051540660 for instance c6728102-8a08-438b-bda8-7d8198949d16 on hv-cinder-83109 Mar 02 03:40:37.064513 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-858b9073-87a2-4e21-8e73-cd487f793577 req-0710c69b-ef1f-4198-acf1-eda47121905f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052524 Mar 02 03:40:37.065427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 253/483] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:37.066655 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:37.067287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:37.068230 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:37.068597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:37.095559 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:40:37.102418 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for user c3aa2415a0a1430686ee1e519c02bef0 and project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:40:37.118939 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:40:37.121435 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:40:37.178453 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-85fac8cc-dafd-4cb7-867e-31f62f33fff1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.642347 Mar 02 03:40:37.185305 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 231/484] 10.222.0.23 () {62 vars in 1187 bytes} [Wed Mar 2 03:40:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 02 03:40:37.191876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d424d2cf-0695-4cc2-bb67-4adb7e7730c9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:37.192598 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d424d2cf-0695-4cc2-bb67-4adb7e7730c9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:37.325616 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d424d2cf-0695-4cc2-bb67-4adb7e7730c9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:37.333556 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d424d2cf-0695-4cc2-bb67-4adb7e7730c9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:37.335078 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d424d2cf-0695-4cc2-bb67-4adb7e7730c9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:37.336749 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d424d2cf-0695-4cc2-bb67-4adb7e7730c9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1281 microversion: 2.20 time: 0.149755 Mar 02 03:40:37.338247 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 254/485] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:37 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1281 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:37.591026 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:37.591654 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:37.613762 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:37.614219 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:37.621408 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:37.622452 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:37.800111 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:37.808832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-aa3c6aeb-c60b-470c-b6e2-f616d900f853 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1362 microversion: 2.1 time: 0.224297 Mar 02 03:40:37.810434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 232/486] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:37 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:40:38.356397 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:38.357007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:38.363926 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:38.364380 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:38.365195 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:38.365625 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:38.435108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:38.443582 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:38.446011 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:38.447427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1f53cd48-11d9-487b-a311-bd484c576eda tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1333 microversion: 2.20 time: 0.095762 Mar 02 03:40:38.447985 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 255/487] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:38 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:40:38.826994 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:38.828463 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:38.834972 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:38.835573 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:38.836526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:38.837057 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:39.055801 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:39.063150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cbc37f6c-0e5c-4779-8735-078c81612dd3 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1548 microversion: 2.1 time: 0.240397 Mar 02 03:40:39.063722 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 233/488] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:40:38 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:40:39.079903 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fa4591a0-33b3-4b32-b141-26d7ec7c708b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:39.080501 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fa4591a0-33b3-4b32-b141-26d7ec7c708b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:39.086387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa4591a0-33b3-4b32-b141-26d7ec7c708b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:39.086916 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa4591a0-33b3-4b32-b141-26d7ec7c708b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:39.087797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa4591a0-33b3-4b32-b141-26d7ec7c708b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:39.088309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa4591a0-33b3-4b32-b141-26d7ec7c708b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:39.210501 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fa4591a0-33b3-4b32-b141-26d7ec7c708b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134711 Mar 02 03:40:39.211601 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 256/489] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Mar 2 03:40:39 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:39.466328 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:39.466951 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:39.473305 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:39.474106 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:39.475276 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:39.475718 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:39.754965 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:39.765823 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:39.767787 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:39.769070 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-355e4dfe-92d3-4e0c-a846-57159a241f07 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.306734 Mar 02 03:40:39.779811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 234/490] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:39 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:40.113212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-1cb80924-14c9-4fc5-bff7-7776f48c7a84 req-dddee9a4-5008-4414-9ab1-dd723b8340ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339a8aac-b54d-4b5e-9963-b2d6282de477", "tag": "4ba0ee61-14d5-4764-9f25-5df359f9822b"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:40.127646 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-1cb80924-14c9-4fc5-bff7-7776f48c7a84 req-dddee9a4-5008-4414-9ab1-dd723b8340ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:40.128167 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-1cb80924-14c9-4fc5-bff7-7776f48c7a84 req-dddee9a4-5008-4414-9ab1-dd723b8340ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:40.143222 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-1cb80924-14c9-4fc5-bff7-7776f48c7a84 req-dddee9a4-5008-4414-9ab1-dd723b8340ee service nova] Creating event network-changed:4ba0ee61-14d5-4764-9f25-5df359f9822b for instance 339a8aac-b54d-4b5e-9963-b2d6282de477 on hv-cinder-83109 Mar 02 03:40:40.150367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-1cb80924-14c9-4fc5-bff7-7776f48c7a84 req-dddee9a4-5008-4414-9ab1-dd723b8340ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041493 Mar 02 03:40:40.151680 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 257/491] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:40.324962 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-268be813-a966-46a9-aa92-6be1d80aa00a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:40.325441 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-268be813-a966-46a9-aa92-6be1d80aa00a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:40.331682 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-a9cc5681-d93d-4c87-bd8f-700499f54280 req-0cdb546f-e5a5-4127-8c01-45efb3e5b2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6728102-8a08-438b-bda8-7d8198949d16", "tag": "ae2d5a72-79a7-4805-8ddb-58e051540660"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:40.342517 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268be813-a966-46a9-aa92-6be1d80aa00a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:40.342968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268be813-a966-46a9-aa92-6be1d80aa00a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:40.343800 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268be813-a966-46a9-aa92-6be1d80aa00a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:40.344209 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-268be813-a966-46a9-aa92-6be1d80aa00a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:40.351200 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-a9cc5681-d93d-4c87-bd8f-700499f54280 req-0cdb546f-e5a5-4127-8c01-45efb3e5b2a3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:40.351904 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-a9cc5681-d93d-4c87-bd8f-700499f54280 req-0cdb546f-e5a5-4127-8c01-45efb3e5b2a3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:40.363623 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-a9cc5681-d93d-4c87-bd8f-700499f54280 req-0cdb546f-e5a5-4127-8c01-45efb3e5b2a3 service nova] Creating event network-changed:ae2d5a72-79a7-4805-8ddb-58e051540660 for instance c6728102-8a08-438b-bda8-7d8198949d16 on hv-cinder-83109 Mar 02 03:40:40.370498 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-a9cc5681-d93d-4c87-bd8f-700499f54280 req-0cdb546f-e5a5-4127-8c01-45efb3e5b2a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042531 Mar 02 03:40:40.371416 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 258/492] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:40:40.390578 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-268be813-a966-46a9-aa92-6be1d80aa00a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/ips" status: 200 len: 106 microversion: 2.1 time: 0.070091 Mar 02 03:40:40.391339 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 235/493] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Mar 2 03:40:40 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/ips => generated 106 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:40.788089 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:40.789841 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:40.802219 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:40.809190 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:40.810898 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:40.811455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:41.041740 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:41.050028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:41.051804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:41.053127 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3bfdbb6d-25ba-4c6a-bd74-29c14229faa6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.270100 Mar 02 03:40:41.054230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 259/494] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:40 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:41.842595 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-54cbe81f-3122-48ae-b16e-1fcd118ff51c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f0965a3-dbbe-4c33-8844-31882570d00a"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:41.843820 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-54cbe81f-3122-48ae-b16e-1fcd118ff51c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:41.849975 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54cbe81f-3122-48ae-b16e-1fcd118ff51c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:41.850417 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54cbe81f-3122-48ae-b16e-1fcd118ff51c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:41.851211 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54cbe81f-3122-48ae-b16e-1fcd118ff51c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:41.852264 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-54cbe81f-3122-48ae-b16e-1fcd118ff51c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:42.072393 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:42.073005 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:42.079281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:42.079728 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:42.080502 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:42.081057 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:42.105676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-54cbe81f-3122-48ae-b16e-1fcd118ff51c tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266755 Mar 02 03:40:42.107324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 236/495] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:40:41 2022] POST /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:42.230712 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:42.238275 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:42.239792 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:42.240888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-347699be-e445-4325-8790-f29d9808aca9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.173003 Mar 02 03:40:42.241469 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 260/496] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:42 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:43.260883 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:43.261572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:43.268126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:43.268570 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:43.269347 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:43.269773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:43.400600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:43.408164 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:43.409646 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:43.410741 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2b6aa54c-83f1-47ce-9c69-a3fac2da9e8d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.155335 Mar 02 03:40:43.411327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 237/497] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:43 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:44.428711 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:44.429380 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:44.436028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:44.436517 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:44.437358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:44.437791 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:44.592214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:44.600434 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:44.601936 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:44.603913 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fc089e80-af04-4c26-89fa-6c2519efc59d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.178958 Mar 02 03:40:44.604704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 261/498] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:44 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:45.623807 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:45.624421 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:45.630621 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:45.631099 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:45.631930 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:45.632368 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:45.764379 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:45.772245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:45.773752 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:45.775187 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c1aea26e-f5e4-4a96-bba1-08cd1906d678 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.155257 Mar 02 03:40:45.775746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 238/499] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:45 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:40:46.792933 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:46.793549 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:46.799851 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:46.800307 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:46.801080 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:46.801520 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:46.941218 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:46.949559 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:46.951358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:46.952458 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4849a61c-b6ad-4ae8-b1eb-963c8f30ad48 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.163539 Mar 02 03:40:46.953020 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 262/500] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:46 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:47.033362 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-6163edf2-95f7-451e-94eb-2e6bb8f057df req-82c84fb0-a744-4bc6-a92d-75b27ed2a0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339a8aac-b54d-4b5e-9963-b2d6282de477", "name": "network-vif-plugged", "status": "completed", "tag": "4ba0ee61-14d5-4764-9f25-5df359f9822b"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:47.042342 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-6163edf2-95f7-451e-94eb-2e6bb8f057df req-82c84fb0-a744-4bc6-a92d-75b27ed2a0ab service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:47.042906 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-6163edf2-95f7-451e-94eb-2e6bb8f057df req-82c84fb0-a744-4bc6-a92d-75b27ed2a0ab service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:47.054210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-6163edf2-95f7-451e-94eb-2e6bb8f057df req-82c84fb0-a744-4bc6-a92d-75b27ed2a0ab service nova] Creating event network-vif-plugged:4ba0ee61-14d5-4764-9f25-5df359f9822b for instance 339a8aac-b54d-4b5e-9963-b2d6282de477 on hv-cinder-83109 Mar 02 03:40:47.060066 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-6163edf2-95f7-451e-94eb-2e6bb8f057df req-82c84fb0-a744-4bc6-a92d-75b27ed2a0ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030353 Mar 02 03:40:47.060676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 239/501] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:47.970518 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:47.971069 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:47.978297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:47.978767 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:47.979570 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:47.980002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:48.108413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:48.116011 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:48.117498 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:48.118670 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8f8e6099-cfe6-41f4-8d05-e0b597255950 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1407 microversion: 2.20 time: 0.152153 Mar 02 03:40:48.119249 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 263/502] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:47 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:49.137755 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:49.138371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:49.144470 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.144925 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.145725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.146148 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.281562 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:49.289206 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:49.291489 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:40:49.292624 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-99fced6c-4329-4643-b1a6-a59c484be110 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1599 microversion: 2.20 time: 0.159890 Mar 02 03:40:49.293167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 240/503] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:40:49 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:40:49.310016 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e5cc1af7-566f-480c-8d34-15c50434f892 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:49.310521 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e5cc1af7-566f-480c-8d34-15c50434f892 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:49.316761 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e5cc1af7-566f-480c-8d34-15c50434f892 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.317227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e5cc1af7-566f-480c-8d34-15c50434f892 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.318012 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e5cc1af7-566f-480c-8d34-15c50434f892 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.318459 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e5cc1af7-566f-480c-8d34-15c50434f892 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.399834 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e5cc1af7-566f-480c-8d34-15c50434f892 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093206 Mar 02 03:40:49.400441 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 264/504] 10.222.0.23 () {60 vars in 1315 bytes} [Wed Mar 2 03:40:49 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:40:49.583105 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-705d2f97-b11d-40be-862f-2e91f0c1b8b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:49.584078 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-705d2f97-b11d-40be-862f-2e91f0c1b8b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:49.591282 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-705d2f97-b11d-40be-862f-2e91f0c1b8b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.591786 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-705d2f97-b11d-40be-862f-2e91f0c1b8b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.592586 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-705d2f97-b11d-40be-862f-2e91f0c1b8b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.593000 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-705d2f97-b11d-40be-862f-2e91f0c1b8b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.621018 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-705d2f97-b11d-40be-862f-2e91f0c1b8b0 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042050 Mar 02 03:40:49.621584 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 241/505] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:40:49 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:49.631363 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ef9599c0-201f-4412-8ba9-6ecd4d2d7d76 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:49.631862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ef9599c0-201f-4412-8ba9-6ecd4d2d7d76 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:49.638525 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ef9599c0-201f-4412-8ba9-6ecd4d2d7d76 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.638974 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ef9599c0-201f-4412-8ba9-6ecd4d2d7d76 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.639800 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ef9599c0-201f-4412-8ba9-6ecd4d2d7d76 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:49.640243 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ef9599c0-201f-4412-8ba9-6ecd4d2d7d76 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:49.668560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ef9599c0-201f-4412-8ba9-6ecd4d2d7d76 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/4f0965a3-dbbe-4c33-8844-31882570d00a" status: 200 len: 194 microversion: 2.1 time: 0.040987 Mar 02 03:40:49.669059 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 265/506] 10.222.0.23 () {58 vars in 1412 bytes} [Wed Mar 2 03:40:49 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/4f0965a3-dbbe-4c33-8844-31882570d00a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:40:50.384716 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-be06e816-763e-4cc8-9138-8f7dcf9ac06d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:50.385294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-be06e816-763e-4cc8-9138-8f7dcf9ac06d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:50.386456 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-9820e50d-fefd-4a88-9c77-fd7840e71162 req-aebad601-0a13-4e04-92d8-bd25bb591d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339a8aac-b54d-4b5e-9963-b2d6282de477", "tag": "4ba0ee61-14d5-4764-9f25-5df359f9822b"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:50.391600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be06e816-763e-4cc8-9138-8f7dcf9ac06d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:50.392050 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be06e816-763e-4cc8-9138-8f7dcf9ac06d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:50.393035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be06e816-763e-4cc8-9138-8f7dcf9ac06d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:50.393471 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-be06e816-763e-4cc8-9138-8f7dcf9ac06d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:50.396413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-9820e50d-fefd-4a88-9c77-fd7840e71162 req-aebad601-0a13-4e04-92d8-bd25bb591d90 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:50.396861 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-9820e50d-fefd-4a88-9c77-fd7840e71162 req-aebad601-0a13-4e04-92d8-bd25bb591d90 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:50.412424 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-9820e50d-fefd-4a88-9c77-fd7840e71162 req-aebad601-0a13-4e04-92d8-bd25bb591d90 service nova] Creating event network-changed:4ba0ee61-14d5-4764-9f25-5df359f9822b for instance 339a8aac-b54d-4b5e-9963-b2d6282de477 on hv-cinder-83109 Mar 02 03:40:50.418562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-9820e50d-fefd-4a88-9c77-fd7840e71162 req-aebad601-0a13-4e04-92d8-bd25bb591d90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036148 Mar 02 03:40:50.418930 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-be06e816-763e-4cc8-9138-8f7dcf9ac06d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/ips" status: 200 len: 112 microversion: 2.20 time: 0.039368 Mar 02 03:40:50.419412 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 266/507] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:50.425408 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 242/508] 10.222.0.23 () {60 vars in 1288 bytes} [Wed Mar 2 03:40:50 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/ips => generated 112 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:40:50.989440 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c0c819d0-c5a6-43e7-8beb-124fcb003a1f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30e9e4d9-d97f-4bdb-b665-14adc8e3b1d7"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:40:50.990316 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c0c819d0-c5a6-43e7-8beb-124fcb003a1f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:50.999772 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c0c819d0-c5a6-43e7-8beb-124fcb003a1f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:51.000480 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c0c819d0-c5a6-43e7-8beb-124fcb003a1f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:51.001901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c0c819d0-c5a6-43e7-8beb-124fcb003a1f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:51.002505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c0c819d0-c5a6-43e7-8beb-124fcb003a1f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:51.273575 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c0c819d0-c5a6-43e7-8beb-124fcb003a1f tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "POST /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289570 Mar 02 03:40:51.274777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 267/509] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:40:50 2022] POST /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:40:58.744026 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cc29ee39-bdaf-47ed-9886-3e4c3bb1cc27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:40:58.744928 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cc29ee39-bdaf-47ed-9886-3e4c3bb1cc27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:40:58.751179 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc29ee39-bdaf-47ed-9886-3e4c3bb1cc27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:58.751635 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc29ee39-bdaf-47ed-9886-3e4c3bb1cc27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:58.752410 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc29ee39-bdaf-47ed-9886-3e4c3bb1cc27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:40:58.752848 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc29ee39-bdaf-47ed-9886-3e4c3bb1cc27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:40:58.781644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cc29ee39-bdaf-47ed-9886-3e4c3bb1cc27 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041588 Mar 02 03:40:58.782203 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 243/510] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:40:58 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:07.092582 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1599983077"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:07.093204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:07.099364 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:07.099842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:07.100626 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:07.101066 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:07.325654 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.network.security_group_api [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Removing security group 536ddb33-f68a-47ef-afcb-e05c974b56c3 from port 11c6cb05-507a-4eff-87c3-ffaf5260ddc9 Mar 02 03:41:07.664887 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7e9c187c-0dfc-4256-a577-b52b8838a87c tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/action" status: 202 len: 0 microversion: 2.1 time: 0.577184 Mar 02 03:41:07.679368 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 268/511] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:41:07 2022] POST /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:41:07.681174 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-de08fc22-9014-4fd6-ac9f-cc04b08a0b25 req-efa42b8a-d879-4867-9610-cf004907b2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7fdc23-d2a1-4345-8b3d-9f8c0317898c", "tag": "11c6cb05-507a-4eff-87c3-ffaf5260ddc9"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:07.701540 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-de08fc22-9014-4fd6-ac9f-cc04b08a0b25 req-efa42b8a-d879-4867-9610-cf004907b2d8 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:07.702038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-de08fc22-9014-4fd6-ac9f-cc04b08a0b25 req-efa42b8a-d879-4867-9610-cf004907b2d8 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:07.720746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-de08fc22-9014-4fd6-ac9f-cc04b08a0b25 req-efa42b8a-d879-4867-9610-cf004907b2d8 service nova] Creating event network-changed:11c6cb05-507a-4eff-87c3-ffaf5260ddc9 for instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c on hv-cinder-83109 Mar 02 03:41:07.735977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-de08fc22-9014-4fd6-ac9f-cc04b08a0b25 req-efa42b8a-d879-4867-9610-cf004907b2d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062728 Mar 02 03:41:07.736788 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 244/512] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:09.350227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:09.350736 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:09.357488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:09.358098 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:09.358890 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:09.359502 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:09.436227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lazy-loading 'services' on Instance uuid 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:41:09.504969 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ed280309-e7ed-4fa8-88ab-23bb7cc32b70 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments/1d889b24-9d1a-4f51-a19b-dd0438e3646d" status: 202 len: 0 microversion: 2.1 time: 0.158961 Mar 02 03:41:09.509127 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 269/513] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:41:09 2022] DELETE /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments/1d889b24-9d1a-4f51-a19b-dd0438e3646d => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:41:09.517621 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7fca0ede-4ebc-4a89-9daa-f8cbdd94852e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:09.518702 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7fca0ede-4ebc-4a89-9daa-f8cbdd94852e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:09.527415 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7fca0ede-4ebc-4a89-9daa-f8cbdd94852e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:09.527970 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7fca0ede-4ebc-4a89-9daa-f8cbdd94852e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:09.528947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7fca0ede-4ebc-4a89-9daa-f8cbdd94852e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:09.529392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7fca0ede-4ebc-4a89-9daa-f8cbdd94852e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:09.559314 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7fca0ede-4ebc-4a89-9daa-f8cbdd94852e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048505 Mar 02 03:41:09.560209 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 245/514] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:41:09 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:41:09.751059 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-44898cef-4fcc-488a-b02f-eab984afd12c req-4a66d9e8-2db6-4016-970a-56cbd44263da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7fdc23-d2a1-4345-8b3d-9f8c0317898c", "tag": "11c6cb05-507a-4eff-87c3-ffaf5260ddc9"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:09.761729 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-44898cef-4fcc-488a-b02f-eab984afd12c req-4a66d9e8-2db6-4016-970a-56cbd44263da service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:09.762177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-44898cef-4fcc-488a-b02f-eab984afd12c req-4a66d9e8-2db6-4016-970a-56cbd44263da service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:09.773700 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-44898cef-4fcc-488a-b02f-eab984afd12c req-4a66d9e8-2db6-4016-970a-56cbd44263da service nova] Creating event network-changed:11c6cb05-507a-4eff-87c3-ffaf5260ddc9 for instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c on hv-cinder-83109 Mar 02 03:41:09.779166 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-44898cef-4fcc-488a-b02f-eab984afd12c req-4a66d9e8-2db6-4016-970a-56cbd44263da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032072 Mar 02 03:41:09.779777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 270/515] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:10.572395 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-91377980-2f6e-4f16-aa10-438807fab05f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:10.573260 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-91377980-2f6e-4f16-aa10-438807fab05f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:10.579809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91377980-2f6e-4f16-aa10-438807fab05f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:10.580264 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91377980-2f6e-4f16-aa10-438807fab05f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:10.581042 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91377980-2f6e-4f16-aa10-438807fab05f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:10.581474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-91377980-2f6e-4f16-aa10-438807fab05f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:10.610180 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-91377980-2f6e-4f16-aa10-438807fab05f tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042357 Mar 02 03:41:10.610747 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 246/516] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:41:10 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:41:10.622469 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:10.623082 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:10.629172 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:10.629617 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:10.630388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:10.630825 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:10.702312 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] HTTP exception thrown: Instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c is not attached to volume 1d889b24-9d1a-4f51-a19b-dd0438e3646d Mar 02 03:41:10.702909 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Returning 404 to user: Instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c is not attached to volume 1d889b24-9d1a-4f51-a19b-dd0438e3646d {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:41:10.703780 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8e3393f6-2873-4386-b676-6ff1c4ca10aa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments/1d889b24-9d1a-4f51-a19b-dd0438e3646d" status: 404 len: 154 microversion: 2.1 time: 0.087095 Mar 02 03:41:10.704314 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 271/517] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:41:10 2022] DELETE /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c/os-volume_attachments/1d889b24-9d1a-4f51-a19b-dd0438e3646d => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:41:11.832083 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:11.832574 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:11.839355 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:11.839803 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:11.840564 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:11.840995 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:11.866691 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:41:11.936801 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ff63e441-92ec-4fbd-b73c-627f1f3a7f75 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 204 len: 0 microversion: 2.1 time: 0.108233 Mar 02 03:41:11.937425 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 247/518] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:41:11 2022] DELETE /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:41:11.945734 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:11.946409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:11.953055 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:11.953507 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:11.954289 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:11.954722 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:12.087813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:12.095023 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ca82a54c-08b4-4f78-b4a4-b55e430f9ca2 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1554 microversion: 2.1 time: 0.153198 Mar 02 03:41:12.095616 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 272/519] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:11 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:13.113893 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:13.114505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:13.120938 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:13.121384 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:13.122151 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:13.122577 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:13.301818 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:13.309169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a0ec7b7a-a82a-4f2c-8654-c61ffd4f92be tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1554 microversion: 2.1 time: 0.199588 Mar 02 03:41:13.309734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 248/520] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:13 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:14.326640 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:14.327236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:14.333500 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:14.333947 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:14.334725 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:14.335182 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:14.542415 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-1b481ef7-16a2-44ff-ae4c-96f9b1b1c34b req-009f75fc-4b34-4819-9470-e3542b254335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7fdc23-d2a1-4345-8b3d-9f8c0317898c", "name": "network-vif-deleted", "tag": "11c6cb05-507a-4eff-87c3-ffaf5260ddc9"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:14.551163 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-1b481ef7-16a2-44ff-ae4c-96f9b1b1c34b req-009f75fc-4b34-4819-9470-e3542b254335 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:14.551616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-1b481ef7-16a2-44ff-ae4c-96f9b1b1c34b req-009f75fc-4b34-4819-9470-e3542b254335 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:14.563510 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-1b481ef7-16a2-44ff-ae4c-96f9b1b1c34b req-009f75fc-4b34-4819-9470-e3542b254335 service nova] Creating event network-vif-deleted:11c6cb05-507a-4eff-87c3-ffaf5260ddc9 for instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c on hv-cinder-83109 Mar 02 03:41:14.569393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-1b481ef7-16a2-44ff-ae4c-96f9b1b1c34b req-009f75fc-4b34-4819-9470-e3542b254335 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Mar 02 03:41:14.570192 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 249/521] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:41:14.572482 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d2173e1b7745df833fcabcb4d5ee99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6b3df4db8641899040ec5bed522a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:14.581261 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-aca45806-83d3-4175-bdc0-ff9419609e5e tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 200 len: 1554 microversion: 2.1 time: 0.258849 Mar 02 03:41:14.581779 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 273/522] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:14 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:41:15.599383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:15.600083 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] [instance: 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:15.606238 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:15.606680 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:15.607480 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:15.607916 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:15.620755 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] HTTP exception thrown: Instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c could not be found. Mar 02 03:41:15.621335 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Returning 404 to user: Instance 1f7fdc23-d2a1-4345-8b3d-9f8c0317898c could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:41:15.622179 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-20fb7bb1-7045-46ad-80d7-28adfc3e41fa tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c" status: 404 len: 111 microversion: 2.1 time: 0.027514 Mar 02 03:41:15.622704 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 250/523] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:15 2022] GET /compute/v2.1/servers/1f7fdc23-d2a1-4345-8b3d-9f8c0317898c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:41:15.630715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-283ad8c2-fa99-45d2-b646-d3899310fee0 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] Calling method '.version_select at 0x7fc37fc20e50>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:15.647579 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-283ad8c2-fa99-45d2-b646-d3899310fee0 tempest-TestMinimumBasicScenario-1381118855 tempest-TestMinimumBasicScenario-1381118855-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-316284167" status: 202 len: 0 microversion: 2.1 time: 0.020589 Mar 02 03:41:15.648132 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 274/524] 10.222.0.23 () {58 vars in 1268 bytes} [Wed Mar 2 03:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-316284167 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:41:21.388490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-215472ac-08f4-4460-8170-dfbb490f614d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:21.389135 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-215472ac-08f4-4460-8170-dfbb490f614d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:21.395696 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-215472ac-08f4-4460-8170-dfbb490f614d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:21.396665 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-215472ac-08f4-4460-8170-dfbb490f614d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:21.398001 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-215472ac-08f4-4460-8170-dfbb490f614d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:21.398001 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-215472ac-08f4-4460-8170-dfbb490f614d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:21.430020 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-215472ac-08f4-4460-8170-dfbb490f614d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/4f0965a3-dbbe-4c33-8844-31882570d00a" status: 200 len: 194 microversion: 2.1 time: 0.162000 Mar 02 03:41:21.430802 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 251/525] 10.222.0.23 () {58 vars in 1412 bytes} [Wed Mar 2 03:41:21 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/4f0965a3-dbbe-4c33-8844-31882570d00a => generated 194 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:21.441047 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:21.441804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:21.449697 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:21.450300 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:21.451243 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:21.451814 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:21.530839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lazy-loading 'services' on Instance uuid c6728102-8a08-438b-bda8-7d8198949d16 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:41:21.606348 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b7948e5a-0450-4c53-8f8b-7da387f07941 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/4f0965a3-dbbe-4c33-8844-31882570d00a" status: 202 len: 0 microversion: 2.1 time: 0.169446 Mar 02 03:41:21.608590 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 275/526] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:41:21 2022] DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/4f0965a3-dbbe-4c33-8844-31882570d00a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:41:23.812686 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-107c41bf-c903-40cb-a265-b93223bd9b63 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:23.813234 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-107c41bf-c903-40cb-a265-b93223bd9b63 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:23.819394 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-107c41bf-c903-40cb-a265-b93223bd9b63 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:23.819847 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-107c41bf-c903-40cb-a265-b93223bd9b63 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:23.821855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-107c41bf-c903-40cb-a265-b93223bd9b63 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:23.822298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-107c41bf-c903-40cb-a265-b93223bd9b63 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:23.850501 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-107c41bf-c903-40cb-a265-b93223bd9b63 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/30e9e4d9-d97f-4bdb-b665-14adc8e3b1d7" status: 200 len: 194 microversion: 2.1 time: 0.041699 Mar 02 03:41:23.851277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 252/527] 10.222.0.23 () {58 vars in 1412 bytes} [Wed Mar 2 03:41:23 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/30e9e4d9-d97f-4bdb-b665-14adc8e3b1d7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:23.862777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:23.863395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:23.870822 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:23.871322 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:23.872115 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:23.872559 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:23.951929 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lazy-loading 'services' on Instance uuid c6728102-8a08-438b-bda8-7d8198949d16 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:41:24.023105 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7171abb9-95b5-41c1-b4f9-f30759d2e9b4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/30e9e4d9-d97f-4bdb-b665-14adc8e3b1d7" status: 202 len: 0 microversion: 2.1 time: 0.164795 Mar 02 03:41:24.025176 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 276/528] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:41:23 2022] DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments/30e9e4d9-d97f-4bdb-b665-14adc8e3b1d7 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:41:25.186208 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9a4538bc-4b0c-4670-afbf-4d06a9e4a175 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:25.187193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9a4538bc-4b0c-4670-afbf-4d06a9e4a175 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:25.193219 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9a4538bc-4b0c-4670-afbf-4d06a9e4a175 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.193679 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9a4538bc-4b0c-4670-afbf-4d06a9e4a175 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.194814 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9a4538bc-4b0c-4670-afbf-4d06a9e4a175 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.196222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9a4538bc-4b0c-4670-afbf-4d06a9e4a175 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.229734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9a4538bc-4b0c-4670-afbf-4d06a9e4a175 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047879 Mar 02 03:41:25.230549 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 253/529] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:41:25 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:41:25.346936 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-be27ec6c-6153-4627-bb99-0c388cced19b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:25.348654 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-be27ec6c-6153-4627-bb99-0c388cced19b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:25.355503 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-be27ec6c-6153-4627-bb99-0c388cced19b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.356189 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-be27ec6c-6153-4627-bb99-0c388cced19b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.357159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-be27ec6c-6153-4627-bb99-0c388cced19b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.357760 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-be27ec6c-6153-4627-bb99-0c388cced19b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.387124 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-be27ec6c-6153-4627-bb99-0c388cced19b tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045052 Mar 02 03:41:25.392796 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 277/530] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:41:25 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:41:25.448062 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:25.449108 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:25.455162 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.455619 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.456400 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.456834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.481350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:41:25.569427 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c462022e-c223-4fb3-b2ab-8b06e9da1fcb tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 204 len: 0 microversion: 2.1 time: 0.126138 Mar 02 03:41:25.570029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 254/531] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:41:25 2022] DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:41:25.579426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:25.580031 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:25.586695 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.587175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.588039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:25.588662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:25.738563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:25.750503 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3619eb6d-16e7-4a4f-9db0-06271859f269 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1672 microversion: 2.1 time: 0.174983 Mar 02 03:41:25.752452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 278/532] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:25 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:26.772315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:26.774972 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:26.782607 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:26.783170 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:26.784164 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:26.784608 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:26.941760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:26.950873 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-736cbffc-2b7b-4adf-82b8-aeae9d1c7302 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1672 microversion: 2.1 time: 0.185428 Mar 02 03:41:26.951485 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 255/533] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:26 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:27.967919 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:27.968521 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:27.976366 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:27.977183 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:27.978203 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:27.978846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:28.216177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:28.224214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5523f263-3a27-494f-b8ac-5b39a3acf05d tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1672 microversion: 2.1 time: 0.260297 Mar 02 03:41:28.235830 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 279/534] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:27 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1672 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:28.671516 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:28.672037 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:28.681072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:28.681529 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:28.682758 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:28.683231 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:28.714886 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lazy-loading 'flavor' on Instance uuid 339a8aac-b54d-4b5e-9963-b2d6282de477 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:41:29.156754 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-6628efd4-a7a5-4fbc-b87c-42d49a226832 req-1d8d9eb2-b6a3-4809-b8a2-946edbc65978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6728102-8a08-438b-bda8-7d8198949d16", "name": "network-vif-deleted", "tag": "ae2d5a72-79a7-4805-8ddb-58e051540660"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:29.171353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-6628efd4-a7a5-4fbc-b87c-42d49a226832 req-1d8d9eb2-b6a3-4809-b8a2-946edbc65978 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:29.173877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-6628efd4-a7a5-4fbc-b87c-42d49a226832 req-1d8d9eb2-b6a3-4809-b8a2-946edbc65978 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:29.194358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-6628efd4-a7a5-4fbc-b87c-42d49a226832 req-1d8d9eb2-b6a3-4809-b8a2-946edbc65978 service nova] Creating event network-vif-deleted:ae2d5a72-79a7-4805-8ddb-58e051540660 for instance c6728102-8a08-438b-bda8-7d8198949d16 on hv-cinder-83109 Mar 02 03:41:29.204620 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-6628efd4-a7a5-4fbc-b87c-42d49a226832 req-1d8d9eb2-b6a3-4809-b8a2-946edbc65978 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384781 Mar 02 03:41:29.208297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 280/535] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:41:29.224923 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cdb15304-3676-4e57-8256-2fde1b922cf0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/action" status: 202 len: 0 microversion: 2.20 time: 0.557356 Mar 02 03:41:29.225951 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 256/536] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Mar 2 03:41:28 2022] POST /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:41:29.240491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:29.241230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:29.243942 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:29.244857 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:29.254026 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:29.254753 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:29.254989 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:29.255534 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:29.256342 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:29.256780 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:29.262985 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:29.262985 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:29.313277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:29.313856 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:29.314312 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lazy-loading 'fault' on Instance uuid c6728102-8a08-438b-bda8-7d8198949d16 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:41:29.379235 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b101d4fa905743eb944d80e401ee5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7eaffa6e46a4505b1573a455ec97201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:29.389838 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7a400d73-4c93-4524-bd05-28daf46e27f2 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 200 len: 1326 microversion: 2.1 time: 0.149611 Mar 02 03:41:29.390659 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 257/537] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:29 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:29.502620 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:29.513114 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:29.514825 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:29.516442 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-df57275f-4313-4453-a720-f715f9cc3386 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.286051 Mar 02 03:41:29.517209 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 281/538] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:29 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:30.409129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:30.410771 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:30.418386 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:30.418842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:30.419730 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:30.420222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:30.438948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] HTTP exception thrown: Instance c6728102-8a08-438b-bda8-7d8198949d16 could not be found. Mar 02 03:41:30.439818 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Returning 404 to user: Instance c6728102-8a08-438b-bda8-7d8198949d16 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:41:30.440827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-792a1e73-fd5f-4095-9b1e-de32300aae44 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 404 len: 111 microversion: 2.1 time: 0.036619 Mar 02 03:41:30.441578 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 258/539] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:30 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:41:30.451108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4bc729cc-a3e3-420c-8cdf-85362a626a5a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '.version_select at 0x7fc37fc20c10>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:30.473425 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4bc729cc-a3e3-420c-8cdf-85362a626a5a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661807575" status: 202 len: 0 microversion: 2.1 time: 0.026445 Mar 02 03:41:30.474122 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 282/540] 10.222.0.23 () {58 vars in 1217 bytes} [Wed Mar 2 03:41:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661807575 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:41:30.536110 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:30.536795 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:30.547828 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:30.548278 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:30.549075 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:30.553753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:30.792440 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:30.808857 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:30.811804 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:30.813415 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1840d240-55bf-4ca1-ad56-bf25edc6ee8f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.281629 Mar 02 03:41:30.827693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 259/541] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:30 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:31.837092 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:31.837796 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:31.848884 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:31.849328 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:31.856455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:31.857145 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:32.172857 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:32.185265 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:32.190576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:32.192608 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7b067353-5938-4bbf-b04e-020ecfdf5f08 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.361185 Mar 02 03:41:32.206182 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 283/542] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:31 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:33.213326 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:33.214635 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:33.232490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:33.233132 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:33.234103 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:33.234542 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:33.534188 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:33.547977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:33.557026 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:33.558475 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d25726cf-517d-40f9-b634-b7fafd26d64b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.350206 Mar 02 03:41:33.559531 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 260/543] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:33 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:41:34.352336 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:34.352877 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:34.359245 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:34.359767 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:34.360618 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:34.361120 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:34.374841 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] HTTP exception thrown: Instance c6728102-8a08-438b-bda8-7d8198949d16 could not be found. Mar 02 03:41:34.375464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Returning 404 to user: Instance c6728102-8a08-438b-bda8-7d8198949d16 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:41:34.376337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-349f4a50-67aa-4d45-ae09-9b5bb45eb089 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 404 len: 111 microversion: 2.1 time: 0.028228 Mar 02 03:41:34.377066 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 284/544] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:41:34 2022] DELETE /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:41:34.385580 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:34.386836 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: c6728102-8a08-438b-bda8-7d8198949d16] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:34.393581 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:34.394317 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:34.395355 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:34.396018 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:34.410936 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] HTTP exception thrown: Instance c6728102-8a08-438b-bda8-7d8198949d16 could not be found. Mar 02 03:41:34.411589 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Returning 404 to user: Instance c6728102-8a08-438b-bda8-7d8198949d16 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:41:34.412558 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1db114b9-59c6-4aa2-88a1-9e34f87ab55a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16" status: 404 len: 111 microversion: 2.1 time: 0.031226 Mar 02 03:41:34.413160 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 261/545] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:34 2022] GET /compute/v2.1/servers/c6728102-8a08-438b-bda8-7d8198949d16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:41:34.577217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:34.577904 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:34.584353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:34.586075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:34.586852 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:34.587314 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:34.882914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:34.892385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:34.894240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:34.895707 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a50d3159-3907-4fd0-8a6a-c35594312081 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.322701 Mar 02 03:41:34.896335 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 285/546] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:34 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:41:35.258765 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9063efb2-53d9-4b7b-a896-6da2b7cc1097 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Action: 'create', calling method: .version_select at 0x7fc38c4de040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2127554969"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:35.272381 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-9063efb2-53d9-4b7b-a896-6da2b7cc1097 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:41:35.276914 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-9063efb2-53d9-4b7b-a896-6da2b7cc1097 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for user a3bf8581a66d4e2aa6b86731b84b8d36 and project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:41:35.386319 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-9063efb2-53d9-4b7b-a896-6da2b7cc1097 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:41:35.390145 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-9063efb2-53d9-4b7b-a896-6da2b7cc1097 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for user a3bf8581a66d4e2aa6b86731b84b8d36 and project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:41:35.404045 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9063efb2-53d9-4b7b-a896-6da2b7cc1097 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.312333 Mar 02 03:41:35.404640 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 262/547] 10.222.0.23 () {60 vars in 1157 bytes} [Wed Mar 2 03:41:35 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:35.585782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:35.586684 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:35.592540 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:35.592999 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:35.593788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:35.594269 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:35.608655 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] HTTP exception thrown: Instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 could not be found. Mar 02 03:41:35.609264 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Returning 404 to user: Instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:41:35.610108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7ae89807-05e3-4ba0-8dcd-577a8e98c0e4 tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 404 len: 111 microversion: 2.1 time: 0.029897 Mar 02 03:41:35.613717 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 286/548] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:41:35 2022] DELETE /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:41:35.618767 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:35.619413 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] [instance: 1e4602d0-7bdf-4d87-a748-e9b324e1a566] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:35.627204 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:35.627667 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:35.628462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:35.628902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:35.645324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] HTTP exception thrown: Instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 could not be found. Mar 02 03:41:35.645952 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] Returning 404 to user: Instance 1e4602d0-7bdf-4d87-a748-e9b324e1a566 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:41:35.647144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-47d2aa35-229f-4cfa-90f8-3d8ac238283a tempest-AttachVolumeTestJSON-2108784280 tempest-AttachVolumeTestJSON-2108784280-project] 10.222.0.23 "GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566" status: 404 len: 111 microversion: 2.1 time: 0.032206 Mar 02 03:41:35.651622 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 263/549] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:35 2022] GET /compute/v2.1/servers/1e4602d0-7bdf-4d87-a748-e9b324e1a566 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:41:35.915444 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:35.916454 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:35.924579 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:35.926144 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:35.927946 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:35.928596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:36.076288 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:36.084056 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:36.086059 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:36.087334 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0a8cac4b-2430-47c0-801a-9128f87e6021 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.177438 Mar 02 03:41:36.087891 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 287/550] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:35 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:37.106173 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:37.106842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:37.115023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:37.115515 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:37.116448 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:37.116897 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:37.313838 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:37.327441 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:37.329237 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:37.333354 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-afd86554-1815-4b59-86f5-76e7b18ffcb6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.231134 Mar 02 03:41:37.338585 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 264/551] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:37 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:41:38.356829 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:38.367183 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:38.392944 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:38.393422 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:38.394189 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:38.405422 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:38.597981 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:38.610538 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:38.612345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:38.613744 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ce3d4666-41c5-4276-a24c-c3929dbe99da tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.261054 Mar 02 03:41:38.614834 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 288/552] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:38 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:39.636260 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:39.636973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:39.645757 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:39.647411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:39.648361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:39.649216 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:39.818836 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:39.833378 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:39.834972 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:39.839298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6cf63b38-4b6b-441a-b246-baaff84316e5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.207915 Mar 02 03:41:39.840080 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 265/553] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:39 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:40.858296 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:40.859000 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:40.865666 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:40.865851 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:40.867426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:40.867869 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:41.049112 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:41.057979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:41.059665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:41.061060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bc841e9a-6f48-484a-8ebb-c5932f7ef3e7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1743 microversion: 2.20 time: 0.207224 Mar 02 03:41:41.061704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 289/554] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:40 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1743 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:42.045768 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-144522982", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "04f05bf1-583d-4ef5-b234-c4a1f3c712fb"}]}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:42.079788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:42.080687 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:42.092517 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:42.092970 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:42.093751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:42.094183 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:42.098748 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] validate_networks() for [('04f05bf1-583d-4ef5-b234-c4a1f3c712fb', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:41:42.314567 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:42.322967 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:42.324508 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:42.325717 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2a0bdd23-6d32-4377-aa0a-749324a16ffc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1743 microversion: 2.20 time: 0.249817 Mar 02 03:41:42.326270 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 290/555] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:42 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:41:42.576527 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:41:42.577644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:41:42.578306 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:41:42.578818 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:41:42.579349 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:41:42.590138 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:42.590840 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:42.591723 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:42.592156 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:42.609168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:41:42.612999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for user 542f04063676401fbb11fbd78bf26145 and project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:41:42.628242 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:41:42.630480 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:41:42.678298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f1b0c465-552a-4bd8-885c-358d16481317 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747721 Mar 02 03:41:42.679210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 266/556] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:41:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:41:42.700393 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fb38a31a-f242-42fa-9d87-90ba4b607766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:42.700895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fb38a31a-f242-42fa-9d87-90ba4b607766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:42.767305 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fb38a31a-f242-42fa-9d87-90ba4b607766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:42.774734 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fb38a31a-f242-42fa-9d87-90ba4b607766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1217 microversion: 2.1 time: 0.082801 Mar 02 03:41:42.775731 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 291/557] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:42 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:43.359591 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:43.361134 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:43.374481 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:43.375727 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:43.376836 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:43.377623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:43.486128 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-0bb13dbc-d4d7-48d4-81c6-c7b8bcb439f6 req-c5db7467-a2a2-43c1-b37f-69c9be41f912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339a8aac-b54d-4b5e-9963-b2d6282de477", "name": "network-vif-plugged", "status": "completed", "tag": "4ba0ee61-14d5-4764-9f25-5df359f9822b"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:43.521295 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-0bb13dbc-d4d7-48d4-81c6-c7b8bcb439f6 req-c5db7467-a2a2-43c1-b37f-69c9be41f912 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:43.526083 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-0bb13dbc-d4d7-48d4-81c6-c7b8bcb439f6 req-c5db7467-a2a2-43c1-b37f-69c9be41f912 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:43.545503 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-0bb13dbc-d4d7-48d4-81c6-c7b8bcb439f6 req-c5db7467-a2a2-43c1-b37f-69c9be41f912 service nova] Creating event network-vif-plugged:4ba0ee61-14d5-4764-9f25-5df359f9822b for instance 339a8aac-b54d-4b5e-9963-b2d6282de477 on hv-cinder-83109 Mar 02 03:41:43.552629 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-0bb13dbc-d4d7-48d4-81c6-c7b8bcb439f6 req-c5db7467-a2a2-43c1-b37f-69c9be41f912 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170809 Mar 02 03:41:43.553332 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 292/558] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:43.660427 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:43.669461 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:43.672888 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:43.674359 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3b138f43-db6d-468f-b3a1-b11fd18df80a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.329083 Mar 02 03:41:43.675561 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 267/559] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:43 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:43.792985 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:43.793591 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:43.799855 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:43.800296 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:43.801264 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:43.801864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:43.869309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:43.877031 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-cf4eed72-650e-4906-baee-84b152611401 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1269 microversion: 2.1 time: 0.088238 Mar 02 03:41:43.877826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 293/560] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:43 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:44.694481 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:44.695941 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:44.709869 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:44.710322 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:44.711161 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:44.711779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:44.893732 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:44.894411 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:44.901223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:44.901803 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:44.902688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:44.903391 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:44.931025 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:44.939915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:44.941419 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:44.944692 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4618a97d-a023-4f4f-b028-2a19d83ae8c5 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.254566 Mar 02 03:41:44.945878 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 268/561] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:44 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:44.999732 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:45.008149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-eaccacd1-a815-4c2a-a057-18e51253d8ea tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1275 microversion: 2.1 time: 0.118234 Mar 02 03:41:45.009255 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 294/562] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:44 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:45.866962 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:45.867861 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:45.883268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:45.883268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:45.883268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:45.883268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:45.925111 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lazy-loading 'flavor' on Instance uuid 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:41:45.965338 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:45.967388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:45.980087 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:45.980736 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:45.981740 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:45.982344 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:46.044968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7b7fb738-cc28-40f1-869d-61170273c249 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "POST /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3/action" status: 202 len: 0 microversion: 2.1 time: 0.183981 Mar 02 03:41:46.048657 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 269/563] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:41:45 2022] POST /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:41:46.058370 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:46.062102 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:46.077742 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:46.081458 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:46.085222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:46.088065 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:46.591769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:46.600920 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:46.603014 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:46.603655 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:46.606054 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9b1e64eb-5b56-4c46-b9da-e9329e62e66d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.645661 Mar 02 03:41:46.607218 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 295/564] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:45 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:41:46.610443 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f377373f-5d3b-4005-b36d-d3f408a01a78 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1317 microversion: 2.1 time: 0.560313 Mar 02 03:41:46.622237 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 270/565] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:46 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:46.625131 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:46.628038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-567bd0cc-b0d0-4989-8f9f-f0878778bf22 req-201584e3-8409-4b66-bafb-e23065044c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebc0d82-0774-42a6-b910-159a48380ac9", "tag": "7c9d29f6-06cf-404b-b04f-94a3f6ddaa79"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:46.631117 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:46.640037 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-567bd0cc-b0d0-4989-8f9f-f0878778bf22 req-201584e3-8409-4b66-bafb-e23065044c9f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:46.640740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-567bd0cc-b0d0-4989-8f9f-f0878778bf22 req-201584e3-8409-4b66-bafb-e23065044c9f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:46.650430 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:46.653149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:46.653149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:46.653149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:46.669176 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-567bd0cc-b0d0-4989-8f9f-f0878778bf22 req-201584e3-8409-4b66-bafb-e23065044c9f service nova] Creating event network-changed:7c9d29f6-06cf-404b-b04f-94a3f6ddaa79 for instance 2ebc0d82-0774-42a6-b910-159a48380ac9 on hv-cinder-83109 Mar 02 03:41:46.674275 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-567bd0cc-b0d0-4989-8f9f-f0878778bf22 req-201584e3-8409-4b66-bafb-e23065044c9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050417 Mar 02 03:41:46.675122 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 271/566] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:46.944714 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:46.952764 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f4a1bba0-81c6-488d-8d6d-bd912e75a4d4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.344095 Mar 02 03:41:46.953594 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 296/567] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:46 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:47.627300 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:47.628712 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:47.633213 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:47.635520 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:47.636919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:47.637635 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:47.638631 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:47.639300 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:47.650883 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:47.651377 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:47.652180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:47.652618 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:47.927628 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:47.938771 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:47.940920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:47.942357 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1cd8ee6d-81da-48b2-aeec-4f27228af938 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.321179 Mar 02 03:41:47.943014 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 272/568] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:47 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:47.949337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:47.959078 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-81d4d49e-8249-4299-8777-28c42c3af751 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1317 microversion: 2.1 time: 0.334419 Mar 02 03:41:47.961871 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 297/569] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:47 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:47.972790 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:47.972790 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:47.980930 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:47.981478 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:47.982358 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:47.982852 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:48.140484 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:48.150485 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5f2db778-e148-4e82-a1fa-adc415d18f96 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.183117 Mar 02 03:41:48.161597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 273/570] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:47 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:41:48.962528 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:48.963161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:48.969764 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:48.970463 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:48.971484 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:48.972111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:48.978174 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:48.979447 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:48.986250 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:48.987003 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:48.988178 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:48.988669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:49.190605 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:49.201417 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:49.201927 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:49.203599 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:49.209329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4edc23bc-2db8-4593-b907-d94ddc6c7551 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1317 microversion: 2.1 time: 0.235411 Mar 02 03:41:49.210765 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-96baec20-cedc-4cc5-aa67-80156a6fe942 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.253875 Mar 02 03:41:49.212246 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 298/571] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:48 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:49.217131 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:49.218068 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:49.219235 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 274/572] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:48 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:49.224563 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:49.225981 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:49.226874 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:49.227410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:49.395720 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:49.404606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bab1fe9c-da98-4df4-bc9d-1fe7953f7674 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.191049 Mar 02 03:41:49.405375 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 299/573] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:49 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:50.240000 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:50.243462 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:50.247949 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:50.250292 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:50.270106 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:50.274419 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:50.275991 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:50.277749 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:50.278785 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:50.279649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:50.280765 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:50.281771 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:50.550777 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:50.559664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:50.561500 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:50.562761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:50.563246 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0ff35197-cfcc-43f7-a936-b80706ac1b87 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.334661 Mar 02 03:41:50.576312 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 300/574] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:50 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:50.576440 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-53849b48-8a8f-41e9-b593-7b06c50db4b6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1317 microversion: 2.1 time: 0.352876 Mar 02 03:41:50.581762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:50.582732 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:50.588479 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 275/575] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:50 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:50.590850 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:50.591553 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:50.592577 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:50.593079 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:50.749657 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:50.757595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-da9e1ac2-6bec-40a7-85d5-346ad2cf53aa tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.179834 Mar 02 03:41:50.758259 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 301/576] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:50 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:51.389623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-953d65b0-c0b0-4983-abae-3da774458a6a req-e2c569d8-f432-4078-8277-2e54386d8e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebc0d82-0774-42a6-b910-159a48380ac9", "name": "network-vif-plugged", "status": "completed", "tag": "7c9d29f6-06cf-404b-b04f-94a3f6ddaa79"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:51.403525 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-953d65b0-c0b0-4983-abae-3da774458a6a req-e2c569d8-f432-4078-8277-2e54386d8e30 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:51.404363 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-953d65b0-c0b0-4983-abae-3da774458a6a req-e2c569d8-f432-4078-8277-2e54386d8e30 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:51.418169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-953d65b0-c0b0-4983-abae-3da774458a6a req-e2c569d8-f432-4078-8277-2e54386d8e30 service nova] Creating event network-vif-plugged:7c9d29f6-06cf-404b-b04f-94a3f6ddaa79 for instance 2ebc0d82-0774-42a6-b910-159a48380ac9 on hv-cinder-83109 Mar 02 03:41:51.423492 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-953d65b0-c0b0-4983-abae-3da774458a6a req-e2c569d8-f432-4078-8277-2e54386d8e30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039318 Mar 02 03:41:51.424926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 276/577] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:51.584189 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:51.585445 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:51.594971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:51.595192 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:51.595452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:51.595948 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:51.596236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:51.596669 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:51.604203 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:51.604935 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:51.606217 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:51.606657 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:51.936693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:51.946868 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:51.963835 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:51.965357 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:51.966582 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1f6de89b-0515-4d14-8f3e-ff4360fb8173 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.386935 Mar 02 03:41:51.977933 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 302/578] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:51 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:51.984444 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1583d61c-511c-4251-beb6-b9d13d558571 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1317 microversion: 2.1 time: 0.381152 Mar 02 03:41:51.987383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 277/579] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:51 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:41:51.989739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:51.990852 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:51.997275 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:51.997684 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:51.998464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:51.999000 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:52.179485 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:52.190773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ab39e131-a640-4af6-b361-beb1b7202dac tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.210280 Mar 02 03:41:52.191572 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 303/580] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:51 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:52.295954 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1131401825", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2127554969", "security_groups": [{"name": "tempest-secgroup-smoke-1934618105"}], "block_device_mapping_v2": [{"uuid": "387b45be-6849-44cc-953c-02839a3fe5a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "53f235ea-f701-4700-a5bc-959cba0de98f"}]}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:52.436515 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] validate_networks() for [('53f235ea-f701-4700-a5bc-959cba0de98f', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:41:52.843927 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:41:52.844347 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:41:52.844813 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:41:52.845210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:41:52.845616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:41:52.854184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:52.854627 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:52.855468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:52.855900 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:52.871520 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:41:52.875235 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for user a3bf8581a66d4e2aa6b86731b84b8d36 and project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:41:52.930736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:41:52.932830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='387b45be-6849-44cc-953c-02839a3fe5a4',volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:41:52.985487 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:52.986203 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:52.992627 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:52.993079 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:52.993863 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:52.994308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:53.060432 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-daffe868-f881-40ed-aec9-a34ab4df39d5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.768388 Mar 02 03:41:53.065863 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 278/581] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:41:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:41:53.071950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:53.072780 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:53.079580 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:53.080038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:53.080869 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:53.081266 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:53.176385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:53.184870 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:53.186542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:53.187895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d76e4255-9a8c-40ef-aa70-7ef73e1ce36d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1738 microversion: 2.20 time: 0.206422 Mar 02 03:41:53.199085 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 304/582] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:52 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:41:53.199085 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2a2b3899-a8fa-4bd0-bb18-be064952c284 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:53.199085 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2a2b3899-a8fa-4bd0-bb18-be064952c284 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:53.262924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2a2b3899-a8fa-4bd0-bb18-be064952c284 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:53.269506 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:53.272598 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2a2b3899-a8fa-4bd0-bb18-be064952c284 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1095 microversion: 2.1 time: 0.083021 Mar 02 03:41:53.273570 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 305/583] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:53 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:53.288195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-eacf336e-3e1e-4ae9-9d13-c63083a954b8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1317 microversion: 2.1 time: 0.224652 Mar 02 03:41:53.298875 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:53.299736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 279/584] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:53 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:53.300230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:53.309032 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:53.320964 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:53.321910 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:53.322672 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:53.477568 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:53.485021 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f27ce6e0-12fe-4034-b005-21ace9fc5c69 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.210443 Mar 02 03:41:53.485581 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 306/585] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:53 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:54.210706 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:54.211457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:54.218866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.219659 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.220761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.221389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.291410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:54.292746 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:54.299164 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.305336 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.306414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.310366 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.383665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:54.397062 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b1c14845-3969-48dc-b576-bafc71fa4eb5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1211 microversion: 2.1 time: 0.109616 Mar 02 03:41:54.398050 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 307/586] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:54 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:54.403631 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:54.404389 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:54.412333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.412923 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.414002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.414543 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.418095 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:54.426360 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:54.428324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:54.429756 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2cad6732-c999-4b80-ac13-51764946295e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1720 microversion: 2.20 time: 0.223795 Mar 02 03:41:54.430387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 280/587] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:54 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:54.502573 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:54.503402 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:54.510591 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.511188 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.512227 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:54.512876 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:54.590300 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:54.601169 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-47b909df-cd68-4372-b7c0-e03843df7216 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1508 microversion: 2.1 time: 0.201898 Mar 02 03:41:54.602060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 308/588] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:54 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:54.667852 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:54.676017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bcea292f-7709-45ef-92cf-bd77a595c6a3 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.177403 Mar 02 03:41:54.676706 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 281/589] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:54 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:41:55.414464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:55.416183 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:55.423662 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:55.424107 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:55.425420 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:55.425860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:55.450608 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:55.451917 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:55.458445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:55.459932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:55.460274 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:55.460741 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:55.656193 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:55.665937 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0eb876ec-ee1d-410c-bd42-119f1cf60564 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.255826 Mar 02 03:41:55.679463 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:55.682862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 309/590] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:55 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:55.690405 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:55.692708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:55.694958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b3b02679-a8e8-4efe-a506-15293881be7f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1720 microversion: 2.20 time: 0.249046 Mar 02 03:41:55.707241 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 282/591] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:55 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:55.707241 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:55.707241 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:55.714065 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:55.714526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:55.715476 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:55.716046 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:55.770291 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-68a01b22-0ade-41d4-a8bc-e4cef74f2e2c req-e6d36895-8e8d-488f-8a73-a7bdc85b8ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c58acd9-faf0-4300-9072-f415d3e63c41", "tag": "096a6539-234c-451d-b2a7-99cd2a6b7b2a"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:55.779137 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-68a01b22-0ade-41d4-a8bc-e4cef74f2e2c req-e6d36895-8e8d-488f-8a73-a7bdc85b8ef3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:55.781194 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-68a01b22-0ade-41d4-a8bc-e4cef74f2e2c req-e6d36895-8e8d-488f-8a73-a7bdc85b8ef3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:55.793293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-68a01b22-0ade-41d4-a8bc-e4cef74f2e2c req-e6d36895-8e8d-488f-8a73-a7bdc85b8ef3 service nova] Creating event network-changed:096a6539-234c-451d-b2a7-99cd2a6b7b2a for instance 7c58acd9-faf0-4300-9072-f415d3e63c41 on hv-cinder-83109 Mar 02 03:41:55.800210 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-68a01b22-0ade-41d4-a8bc-e4cef74f2e2c req-e6d36895-8e8d-488f-8a73-a7bdc85b8ef3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115762 Mar 02 03:41:55.801194 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 310/592] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:41:55.877741 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:55.885274 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3cb81fa8-1e2c-4669-99da-37ae9e7bfc5e tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.184176 Mar 02 03:41:55.885843 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 283/593] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:55 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:56.001111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-15cb03eb-82a7-45cd-bafc-d83d19119e03 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "066365f3-bb2a-41f4-9707-8c9980cd39b8"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:56.002385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-15cb03eb-82a7-45cd-bafc-d83d19119e03 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:56.009420 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-15cb03eb-82a7-45cd-bafc-d83d19119e03 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.009959 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-15cb03eb-82a7-45cd-bafc-d83d19119e03 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.010871 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-15cb03eb-82a7-45cd-bafc-d83d19119e03 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.011414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-15cb03eb-82a7-45cd-bafc-d83d19119e03 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.347075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-15cb03eb-82a7-45cd-bafc-d83d19119e03 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350685 Mar 02 03:41:56.347969 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 311/594] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:41:55 2022] POST /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:41:56.683165 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:56.684505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:56.691120 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.691650 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.692512 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.693160 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.717691 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:56.719016 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:56.726370 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.726990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.727807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.728243 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.963626 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:56.971225 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dfecf8fa-c9ba-49c5-9c5a-ed2eb66b6803 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.291862 Mar 02 03:41:56.971880 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 284/595] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:56 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:56.976656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:56.977394 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:56.977545 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:56.984202 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.984725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.985589 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:56.986105 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:56.986844 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:56.988412 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:56.989762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-979972d9-f0ff-48aa-9e4b-4ece0e7610ad tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1663 microversion: 2.20 time: 0.278118 Mar 02 03:41:56.992784 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 312/596] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:56 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1663 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:41:57.012856 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6c816f04-c341-40a4-9e60-864eec471149 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff5358bd-4bde-4603-95fe-94322b558381"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:57.014234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6c816f04-c341-40a4-9e60-864eec471149 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:57.020281 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6c816f04-c341-40a4-9e60-864eec471149 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.020728 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6c816f04-c341-40a4-9e60-864eec471149 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.021508 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6c816f04-c341-40a4-9e60-864eec471149 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.022294 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6c816f04-c341-40a4-9e60-864eec471149 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.219740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:57.242742 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8f610cc6-69ec-4f81-a38b-0bbdb7122a6d tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.269833 Mar 02 03:41:57.243352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 285/597] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:56 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:57.310633 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6c816f04-c341-40a4-9e60-864eec471149 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303944 Mar 02 03:41:57.311212 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 313/598] 10.222.0.23 () {62 vars in 1363 bytes} [Wed Mar 2 03:41:57 2022] POST /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:41:57.357526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-b326033e-c2fb-486c-97a4-504d47a78bfd req-6df78f5a-6566-4fbf-9183-772ec5fde8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339a8aac-b54d-4b5e-9963-b2d6282de477", "name": "network-vif-unplugged", "status": "completed", "tag": "4ba0ee61-14d5-4764-9f25-5df359f9822b"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:57.367357 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-b326033e-c2fb-486c-97a4-504d47a78bfd req-6df78f5a-6566-4fbf-9183-772ec5fde8fa service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.368007 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-b326033e-c2fb-486c-97a4-504d47a78bfd req-6df78f5a-6566-4fbf-9183-772ec5fde8fa service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.380267 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.compute.server_external_events [req-b326033e-c2fb-486c-97a4-504d47a78bfd req-6df78f5a-6566-4fbf-9183-772ec5fde8fa service nova] Unable to find a host for instance 339a8aac-b54d-4b5e-9963-b2d6282de477. Dropping event network-vif-unplugged {{(pid=123425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 02 03:41:57.382108 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-b326033e-c2fb-486c-97a4-504d47a78bfd req-6df78f5a-6566-4fbf-9183-772ec5fde8fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028612 Mar 02 03:41:57.382927 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 286/599] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 02 03:41:57.426986 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a8109026-2bed-4b04-a530-499137f10f39 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:57.427649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a8109026-2bed-4b04-a530-499137f10f39 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:57.434484 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a8109026-2bed-4b04-a530-499137f10f39 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.435174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a8109026-2bed-4b04-a530-499137f10f39 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.435947 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a8109026-2bed-4b04-a530-499137f10f39 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.436448 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a8109026-2bed-4b04-a530-499137f10f39 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.523043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a8109026-2bed-4b04-a530-499137f10f39 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/action" status: 202 len: 0 microversion: 2.20 time: 0.102102 Mar 02 03:41:57.523665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 314/600] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Mar 2 03:41:57 2022] POST /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:41:57.531983 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:57.532631 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:57.539335 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.539793 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.540572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.541013 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.684550 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:57.693028 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:57.695193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:57.696357 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8467b84d-69ec-489e-be07-90dd6940b8ef tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1749 microversion: 2.20 time: 0.168467 Mar 02 03:41:57.696923 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 287/601] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:57 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:57.988922 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:57.989686 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:57.997154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.997609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:57.998390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:57.998831 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:58.176094 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:58.184354 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0dbe4a3e-83f7-4629-8db6-02c64219e8cf tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.199713 Mar 02 03:41:58.185233 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 315/602] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:57 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:58.259932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:58.260813 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:58.266856 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:58.267420 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:58.268193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:58.268634 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:58.411125 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:58.419315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-16ffa1eb-5aed-4187-bb7f-37d44789eed9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.163172 Mar 02 03:41:58.420077 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 288/603] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:58 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:58.715217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:58.715755 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:58.721561 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:58.722004 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:58.722761 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:58.723221 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:58.859482 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:58.868399 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:58.869918 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:58.871094 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-10cb323a-ed48-4236-a8d3-09a0722128dc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1751 microversion: 2.20 time: 0.159799 Mar 02 03:41:58.871682 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 316/604] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:58 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:41:59.201717 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:59.202427 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:59.208866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.210080 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.210868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.211350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.347543 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:59.354764 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b6478732-f081-4fa3-9b8c-ecfa3a4a9907 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.156979 Mar 02 03:41:59.355371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 289/605] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:59 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:59.437176 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:59.437715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:59.444635 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.445088 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.445869 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.446312 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.580850 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:59.589284 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-85d8d697-8895-497d-93f4-9ac60bdb2bc7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1569 microversion: 2.1 time: 0.156009 Mar 02 03:41:59.589858 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 317/606] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:59 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:59.606624 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-621c26e3-744d-4d0a-9e7e-4d65eac0e657 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:41:59.607222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-621c26e3-744d-4d0a-9e7e-4d65eac0e657 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:59.612974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-621c26e3-744d-4d0a-9e7e-4d65eac0e657 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.613419 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-621c26e3-744d-4d0a-9e7e-4d65eac0e657 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.614185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-621c26e3-744d-4d0a-9e7e-4d65eac0e657 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.614611 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-621c26e3-744d-4d0a-9e7e-4d65eac0e657 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.704315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-621c26e3-744d-4d0a-9e7e-4d65eac0e657 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "POST /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3/action" status: 202 len: 0 microversion: 2.1 time: 0.101459 Mar 02 03:41:59.705205 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 290/607] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Mar 2 03:41:59 2022] POST /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:41:59.713819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:59.714423 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:59.720330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.720785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.721576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.722007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.863714 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:41:59.871974 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-943f80b8-4df3-4d66-a7ad-27b026329e28 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1517 microversion: 2.1 time: 0.162486 Mar 02 03:41:59.872556 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 318/608] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:41:59 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:41:59.889673 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:41:59.890437 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:41:59.896499 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.897012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:41:59.897984 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:41:59.898423 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:00.081941 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:00.091248 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:00.092736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:00.093883 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d8551016-c012-4f8a-8cd2-bedd619e3f2b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1751 microversion: 2.20 time: 0.208211 Mar 02 03:42:00.094441 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 291/609] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:41:59 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:00.371739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:00.372346 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:00.378671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:00.379154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:00.380550 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:00.381616 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:00.518840 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:00.526814 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e6a47a41-3e0d-4fdf-92eb-c0bcfacad59b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.159004 Mar 02 03:42:00.527415 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 319/610] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:00 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:00.889330 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:00.889935 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:00.896204 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:00.896779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:00.897574 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:00.898002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:01.028302 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:01.035564 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d3c2d317-346c-44cf-9a28-514b50fdd7a2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1519 microversion: 2.1 time: 0.150115 Mar 02 03:42:01.036163 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 292/611] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:00 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:01.112584 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:01.113124 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:01.119788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:01.120246 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:01.121025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:01.121487 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:01.256337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:01.264332 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:01.265842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:01.266990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-32600a6b-8cf2-4cf1-ada8-960b8c40ddb0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1751 microversion: 2.20 time: 0.158367 Mar 02 03:42:01.267614 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 320/612] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:01 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:01.544020 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:01.544688 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:01.550779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:01.551268 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:01.552042 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:01.552477 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:01.685217 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:01.692473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3715a5aa-3256-49e2-831c-08466464acd6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.152771 Mar 02 03:42:01.693022 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 293/613] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:01 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:02.053848 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:02.054467 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:02.060748 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:02.061206 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:02.061991 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:02.062433 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:02.285252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:02.285890 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:02.293112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:02.293553 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:02.294346 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:02.294773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:02.457553 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:02.465743 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-dde2bc0b-995a-43fd-aedf-77a261327c93 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1519 microversion: 2.1 time: 0.416352 Mar 02 03:42:02.466323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 321/614] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:02 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:02.548263 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:02.556757 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:02.558224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:02.559435 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2fc78e35-0b59-47db-a331-b149c9283230 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1751 microversion: 2.20 time: 0.278152 Mar 02 03:42:02.560026 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 294/615] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:02 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1751 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:02.710010 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:02.710582 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:02.716555 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:02.717006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:02.717782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:02.718215 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:02.863445 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:02.871965 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-25d0ea28-5fe3-4bad-a7a1-3f21bd0bf889 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.166421 Mar 02 03:42:02.872599 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 322/616] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:02 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:03.485924 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:03.485924 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:03.491910 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:03.492371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:03.496997 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:03.496997 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:03.578837 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:03.579493 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:03.586823 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:03.587306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:03.588274 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:03.588874 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:03.712442 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:03.726167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7291f9e6-7aa7-492b-b90e-4bcbaa5f1451 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1519 microversion: 2.1 time: 0.245636 Mar 02 03:42:03.727177 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 295/617] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:03 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:03.731905 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-e07f9485-28cd-4a2f-b142-93ed5f2ff6ee req-944a25ea-8123-4e76-814c-1b16b7c89a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3", "name": "network-vif-unplugged", "status": "completed", "tag": "56da13d2-0bb5-44a6-b8fd-97adb1a22f9e"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:03.744170 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-e07f9485-28cd-4a2f-b142-93ed5f2ff6ee req-944a25ea-8123-4e76-814c-1b16b7c89a36 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:03.745646 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-e07f9485-28cd-4a2f-b142-93ed5f2ff6ee req-944a25ea-8123-4e76-814c-1b16b7c89a36 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:03.779950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.compute.server_external_events [req-e07f9485-28cd-4a2f-b142-93ed5f2ff6ee req-944a25ea-8123-4e76-814c-1b16b7c89a36 service nova] Unable to find a host for instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3. Dropping event network-vif-unplugged {{(pid=123425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 02 03:42:03.781321 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-e07f9485-28cd-4a2f-b142-93ed5f2ff6ee req-944a25ea-8123-4e76-814c-1b16b7c89a36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052900 Mar 02 03:42:03.781930 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 296/618] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 02 03:42:03.835765 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:03.843974 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:03.845458 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:03.846611 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5c9d7e95-2d9d-4915-84e4-6796641d4c90 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1751 microversion: 2.20 time: 0.273331 Mar 02 03:42:03.847203 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 323/619] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:03 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1751 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:03.889285 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:03.889891 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:03.895577 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:03.896020 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:03.897098 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:03.897530 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:03.909226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-684504330", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "04f05bf1-583d-4ef5-b234-c4a1f3c712fb"}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:03.960804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] validate_networks() for [('04f05bf1-583d-4ef5-b234-c4a1f3c712fb', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:42:04.181939 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:04.190219 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8a4af3d6-e179-47e2-a925-a6bf6e700bc2 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.304735 Mar 02 03:42:04.200023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 297/620] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:03 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:04.564679 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:42:04.565103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:42:04.565577 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:42:04.565987 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:42:04.566442 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:42:04.576092 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:04.576548 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:04.577363 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:04.577802 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:04.596694 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:42:04.601739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for user 542f04063676401fbb11fbd78bf26145 and project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:42:04.612304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:42:04.614578 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:42:04.659817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-007b7632-12ae-4abb-8ca2-0f6ad07c5de0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754380 Mar 02 03:42:04.660685 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 324/621] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 02 03:42:04.671752 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-efbc88cb-440c-43e0-941d-c9f1b78f57f4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:04.672819 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-efbc88cb-440c-43e0-941d-c9f1b78f57f4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:04.744648 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:04.745607 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:04.752723 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:04.753177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:04.753751 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-efbc88cb-440c-43e0-941d-c9f1b78f57f4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:04.754840 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:04.759791 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:04.762190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-efbc88cb-440c-43e0-941d-c9f1b78f57f4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1217 microversion: 2.1 time: 0.095214 Mar 02 03:42:04.763624 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 298/622] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:04 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:04.865083 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:04.866196 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:04.874427 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:04.875746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:04.877226 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:04.879568 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:05.105109 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:05.113550 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-810354b5-06a8-4dd2-b7f7-8507c247aae9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.373410 Mar 02 03:42:05.114129 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 325/623] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:04 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:05.179389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:05.189585 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:05.191359 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:05.192767 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7f4ca2c3-8812-4553-ba82-153d41f19be1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.332124 Mar 02 03:42:05.194016 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 299/624] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:04 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:05.214689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:05.215977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:05.225632 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:05.226244 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:05.227076 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:05.227682 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:05.409478 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:05.431183 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1fcdabd5-6670-4721-8be5-4c149fef9073 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.226291 Mar 02 03:42:05.435166 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 326/625] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:05 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:05.780915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:05.782387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:05.791834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:05.792640 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:05.793684 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:05.794642 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:05.799255 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-ffdc0b45-a17c-46c8-9378-208a38543e47 req-94a57099-c73e-41c2-934a-1692e3c208cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c58acd9-faf0-4300-9072-f415d3e63c41", "name": "network-vif-plugged", "status": "completed", "tag": "096a6539-234c-451d-b2a7-99cd2a6b7b2a"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:05.818901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-ffdc0b45-a17c-46c8-9378-208a38543e47 req-94a57099-c73e-41c2-934a-1692e3c208cd service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:05.819698 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-ffdc0b45-a17c-46c8-9378-208a38543e47 req-94a57099-c73e-41c2-934a-1692e3c208cd service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:05.848491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-ffdc0b45-a17c-46c8-9378-208a38543e47 req-94a57099-c73e-41c2-934a-1692e3c208cd service nova] Creating event network-vif-plugged:096a6539-234c-451d-b2a7-99cd2a6b7b2a for instance 7c58acd9-faf0-4300-9072-f415d3e63c41 on hv-cinder-83109 Mar 02 03:42:05.867912 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:05.872453 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-ffdc0b45-a17c-46c8-9378-208a38543e47 req-94a57099-c73e-41c2-934a-1692e3c208cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076733 Mar 02 03:42:05.873069 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 327/626] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:42:05.877805 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8ceddca2-e3d1-4879-bcf1-eb9940b921bc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.101408 Mar 02 03:42:05.879236 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 300/627] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:05 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:06.132333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:06.132947 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:06.139062 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.139522 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.140301 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.140736 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.212473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:06.213113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:06.219289 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.219747 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.220546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.220988 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.326640 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:06.335455 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-00478a48-51d0-443f-b036-bd0579051561 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.207944 Mar 02 03:42:06.345802 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 328/628] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:06 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:06.406385 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:06.414928 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:06.416490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:06.417652 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f31c3d20-feac-402a-9dd8-542c7b41822a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.209315 Mar 02 03:42:06.418209 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 301/629] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:06 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:06.452450 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:06.453074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:06.459559 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.460178 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.460973 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.461409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.601745 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:06.609102 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-486ab6dc-c4e1-4b4e-81f5-95b9ab6ef1ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.160823 Mar 02 03:42:06.609670 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 329/630] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:06 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:06.895166 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:06.896012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:06.902842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.903320 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.904124 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:06.904565 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:06.969926 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:06.978036 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5c02cfca-3233-4b32-94e9-8ab3ee8de723 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.086656 Mar 02 03:42:06.980142 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 302/631] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:06 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:07.353392 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:07.354105 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:07.360478 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:07.360928 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:07.361709 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:07.362177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:07.436276 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:07.436893 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:07.442632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:07.443157 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:07.444107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:07.444556 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:07.531390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:07.539737 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0db8d8d7-009f-4f2f-8112-aef27849cfb2 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.190853 Mar 02 03:42:07.540333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 330/632] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:07 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:07.616938 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:07.625749 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:07.626054 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:07.626697 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:07.627583 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:07.628790 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-397faa93-5b1d-4bef-bd04-79f2bfd7fcf8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.196410 Mar 02 03:42:07.629686 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 303/633] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:07 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:07.643352 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:07.643889 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:07.644748 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:07.645251 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:07.786494 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:07.795338 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7dece038-485a-415c-8ed8-72c94e06298a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.173362 Mar 02 03:42:07.796129 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 331/634] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:07 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:07.994003 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:07.994754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:08.001244 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.001919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.002935 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.003573 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.065668 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:08.074244 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b59f8a37-c5d4-4c5d-863e-bd8d9005efe6 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.084223 Mar 02 03:42:08.074810 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 304/635] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:07 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:08.557293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:08.558144 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:08.564240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.564686 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.565465 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.565979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.648087 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:08.648616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:08.654758 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.655392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.656035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.656473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.719560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:08.727833 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-09c83dd0-17e1-48ad-8870-16784e6be1d9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.174478 Mar 02 03:42:08.728408 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 332/636] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:08 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:08.812440 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:08.813060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:08.819218 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:08.826545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.826545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.826545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:08.826545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:08.832180 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:08.833920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:08.835168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-abc2ade5-c6a0-414d-a118-a7f5ab46dd3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.191745 Mar 02 03:42:08.846442 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 305/637] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:08 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:08.972689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:08.980959 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d9fd04d6-0582-4418-bbd6-4a0bc0cbe181 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.172269 Mar 02 03:42:08.981543 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 333/638] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:08 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:09.090773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:09.091405 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:09.097873 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:09.098327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:09.099192 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:09.099631 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:09.160625 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:09.168992 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3a6c9240-3600-47e1-bb60-afe450327cad tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.081911 Mar 02 03:42:09.169505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 306/639] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:09 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:09.746154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:09.746769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:09.753306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:09.753763 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:09.754552 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:09.754990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:09.855143 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:09.856247 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:09.863243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:09.863946 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:09.865446 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:09.865962 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:09.922141 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:09.931530 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-eae97756-6749-48ad-97eb-06016b230390 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.189436 Mar 02 03:42:09.933282 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 334/640] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:09 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:09.997767 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:09.998391 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:10.004380 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:10.004839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:10.006487 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:10.006956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:10.028175 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:10.037769 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:10.039473 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:10.040655 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-600f20e9-dcef-4b0a-9aab-ec369be7c569 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.190582 Mar 02 03:42:10.041550 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 307/641] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:09 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:10.160151 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:10.168717 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-05f6d3e6-4e63-4771-acd5-1969be983612 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.174824 Mar 02 03:42:10.169371 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 335/642] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:09 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:10.185605 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:10.186267 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:10.192924 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:10.193888 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:10.194257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:10.194692 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:10.256190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:10.263398 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cc237458-2215-4b0f-a4f4-3213e60bf836 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.081658 Mar 02 03:42:10.263962 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 308/643] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:10 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:10.950155 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:10.950835 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:10.957413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:10.957863 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:10.958832 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:10.959299 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:11.061678 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:11.062494 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:11.071107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:11.071873 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:11.072754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:11.073307 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:11.109942 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:11.118300 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b623ff7e-9e08-489f-9a63-3000d978de98 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.172270 Mar 02 03:42:11.119376 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 336/644] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:10 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:11.201045 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:11.203091 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:11.220456 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:11.220926 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:11.221740 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:11.222193 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:11.356693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:11.366345 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:11.367788 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:11.368947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-22dc5ef2-f1b3-4aba-b5de-ff77580e410e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.313292 Mar 02 03:42:11.369811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 309/645] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:11 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:11.386412 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:11.387029 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:11.401985 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:11.402450 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:11.403267 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:11.404172 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:11.428398 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:11.436433 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-366fce8c-6e9d-40ac-b570-03f8ff38cd94 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.254362 Mar 02 03:42:11.443732 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 337/646] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:11 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:11.473672 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:11.481834 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-77be71c0-5acb-4fff-9d57-1e9ac04d6ba9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.110951 Mar 02 03:42:11.482411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 310/647] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:11 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:12.149234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:12.149234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:12.155757 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.156211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.157008 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.157454 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.307303 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:12.314968 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-107a096d-1579-40e2-85f6-0672da9d199b tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.173537 Mar 02 03:42:12.315619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 338/648] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:12 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:12.390332 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:12.390938 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:12.397974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.398425 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.399302 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.399687 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.454523 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:12.455565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:12.462117 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.462674 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.463560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.464065 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.583918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:12.592708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:12.594365 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:12.595569 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-96ac8459-05f2-4818-88ea-2f128896f37e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.209151 Mar 02 03:42:12.596260 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 311/649] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:12 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:12.602630 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:12.603685 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:12.611679 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.612129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.613012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:12.613457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:12.676545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:12.685034 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e6852e73-25a2-4e4e-b54c-a9e45f76886d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.234551 Mar 02 03:42:12.685918 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 339/650] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:12 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:12.693324 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:12.701445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-29c284fb-11aa-47ed-949b-75c5bdac3f09 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.104179 Mar 02 03:42:12.702206 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 312/651] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:12 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:13.333132 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:13.333846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:13.340275 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.340721 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.341507 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.341939 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.482006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:13.489544 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-73ffc32b-17e8-4c4a-9bf3-c404ead04045 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.160334 Mar 02 03:42:13.490373 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 340/652] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:13 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:13.613867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:13.614543 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:13.620943 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.621397 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.622175 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.622615 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.704185 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:13.704970 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:13.712864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.714554 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.714896 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.715371 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.794697 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:13.802877 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:13.804415 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:13.805590 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4ce79158-4cad-4484-b016-9651101044cd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.195785 Mar 02 03:42:13.806160 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 313/653] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:13 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:13.810546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:13.811178 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:13.817050 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.817537 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.818511 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:13.818763 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:13.906774 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:13.908351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:13.913589 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bd2adcf9-07c6-4557-9c9f-7133d3d1c04b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.214355 Mar 02 03:42:13.915941 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 341/654] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:13 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:13.925364 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1f630b6e-7753-4047-9334-3cc4107a065a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.118149 Mar 02 03:42:13.926628 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 314/655] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:13 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:14.507127 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:14.507812 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:14.514077 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.514525 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:14.515331 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.515774 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:14.661769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:14.670565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-67f9da00-9957-4ee9-bff6-982d01fa5346 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.167887 Mar 02 03:42:14.671146 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 342/656] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:14 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:14.824656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:14.825233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:14.831469 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.831915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:14.832683 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.833332 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:14.932500 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:14.933139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:14.938862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.939346 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:14.940234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.940673 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:14.970323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:14.980061 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:14.981562 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:14.982740 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5ad13cc6-7ee5-46e5-afa9-e0f47656db68 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.162434 Mar 02 03:42:14.983333 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 315/657] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:14 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:14.987739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:14.988339 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:14.994115 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.994565 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:14.995391 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:14.995829 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:15.066663 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:15.074448 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c2a1a07b-d86b-422c-adc6-1e62a13729ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1269 microversion: 2.1 time: 0.090145 Mar 02 03:42:15.075093 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 316/658] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:14 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:15.097576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:15.105609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ba0c26bd-a227-4eee-9063-df0852427890 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.176911 Mar 02 03:42:15.106174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 343/659] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:14 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:15.691315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:15.691936 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:15.698873 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:15.699359 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:15.700135 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:15.700573 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:15.933809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:15.941056 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-fb35ca67-88a3-45f6-835a-7d1e9830aa22 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.256420 Mar 02 03:42:15.941629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 317/660] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:15 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:16.001481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:16.002106 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:16.008431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.008973 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:16.009747 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.010189 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:16.092872 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:16.093584 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:16.100530 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.101086 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:16.101932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.102426 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:16.180551 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:16.187821 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9954b7ea-175a-4814-a4e6-4b9996bb2766 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1275 microversion: 2.1 time: 0.099328 Mar 02 03:42:16.188607 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 318/661] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:16 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:16.201063 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:16.201699 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:16.207672 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.208222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:16.209513 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.209947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:16.303601 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:16.311856 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:16.313394 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:16.314562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d1e798a6-ae18-4f8c-ba4f-ea481f793214 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.317188 Mar 02 03:42:16.315606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 344/662] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:15 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:16.470757 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:16.484361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bc1fffd0-f01e-4545-998e-e2e4a8c365ff tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1267 microversion: 2.1 time: 0.288093 Mar 02 03:42:16.485031 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 319/663] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:16 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:16.958352 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:16.958992 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:16.965414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.966040 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:16.966860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:16.967330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.206855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:17.207504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:17.217828 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.218363 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.219190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.219624 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.448571 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:17.455864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-68ee51c8-655a-43e1-a537-1e8d909d34f7 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.501594 Mar 02 03:42:17.456433 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 345/664] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:16 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:17.461323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:17.461944 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:17.464368 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:17.468530 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.468935 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.469744 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.470183 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.472618 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ffe75c06-92a7-4e1e-a2e6-a1a61f020194 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1317 microversion: 2.1 time: 0.269823 Mar 02 03:42:17.473369 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 320/665] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:17 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:17.503908 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:17.504620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:17.511298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.511750 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.512529 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.512963 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.808824 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:17.817186 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:17.819451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:17.820610 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7d63ba89-0431-4f26-b2b6-800734ec9112 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.363264 Mar 02 03:42:17.821423 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 346/666] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:17 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:17.831556 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:17.831715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-6aa69668-4693-4d23-ab9a-7ff64b956624 req-90cf42d2-9e1a-45dc-8f55-6d3e56ab495b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3769a4-1a43-4f3f-8010-3b262309cd49", "tag": "930cbda3-c8e7-4fe1-807c-ef20deab0155"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:17.838813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-6aa69668-4693-4d23-ab9a-7ff64b956624 req-90cf42d2-9e1a-45dc-8f55-6d3e56ab495b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.839590 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7ff4539b-5eef-4253-af78-ef4ba929eb3c tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1454 microversion: 2.1 time: 0.339975 Mar 02 03:42:17.839694 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-6aa69668-4693-4d23-ab9a-7ff64b956624 req-90cf42d2-9e1a-45dc-8f55-6d3e56ab495b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.840135 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 321/667] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:17 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1454 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:17.851020 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-6aa69668-4693-4d23-ab9a-7ff64b956624 req-90cf42d2-9e1a-45dc-8f55-6d3e56ab495b service nova] Creating event network-changed:930cbda3-c8e7-4fe1-807c-ef20deab0155 for instance 3a3769a4-1a43-4f3f-8010-3b262309cd49 on hv-cinder-83109 Mar 02 03:42:17.856025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-6aa69668-4693-4d23-ab9a-7ff64b956624 req-90cf42d2-9e1a-45dc-8f55-6d3e56ab495b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033492 Mar 02 03:42:17.856527 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:17.857043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 347/668] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:17.857365 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:17.863652 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.864134 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:17.864959 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:17.865401 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:18.133132 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:18.140431 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6a47a4e5-7250-402f-bf29-85d329085936 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1454 microversion: 2.1 time: 0.288165 Mar 02 03:42:18.141021 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 322/669] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:17 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1454 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:18.474565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:18.475463 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:18.481806 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:18.482257 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:18.483175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:18.483814 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:18.489855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:18.490448 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:18.502005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:18.502460 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:18.503286 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:18.503726 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:18.906616 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:18.909818 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:18.915351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-02846509-47b0-4105-be60-7e7effc08b52 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1317 microversion: 2.1 time: 0.429593 Mar 02 03:42:18.916508 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 323/670] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:18 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:18.917421 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-5d1a7d50-7b78-436e-ac51-4fe82915c259 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.447451 Mar 02 03:42:18.921422 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:18.922233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:18.927503 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 348/671] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:18 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:18.928506 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:18.928958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:18.929739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:18.930184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:19.228222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:19.236332 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:19.237843 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:19.239003 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5429bb23-d65a-4017-8a1d-4c09b2ed0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.321386 Mar 02 03:42:19.240623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 324/672] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:18 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:19.932042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:19.932571 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:19.933993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:19.934580 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:19.938737 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:19.939235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:19.940029 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:19.940468 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:19.940808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:19.941469 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:19.942025 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:19.943367 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:20.573868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:20.578840 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:20.581114 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-28eb5626-eccf-471c-a828-b63bb98f76ff tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.651449 Mar 02 03:42:20.581691 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 325/673] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:19 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:20.587355 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-46f2d5aa-8cc8-4f44-86c2-edfda97d8be7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1317 microversion: 2.1 time: 0.659257 Mar 02 03:42:20.588315 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 349/674] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:19 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:20.603044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:20.603924 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:20.610499 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:20.610950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:20.611756 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:20.612191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:20.838339 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:20.846444 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:20.847958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:20.849623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d4efea5e-5e38-49a7-8365-69725b8b9578 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.253515 Mar 02 03:42:20.850159 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 326/675] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:20 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:20.951012 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-f6a0ca09-36a9-4446-89fd-7b2081f849ba req-35d072f4-731a-4a78-b614-785c3d29d142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c58acd9-faf0-4300-9072-f415d3e63c41", "tag": "096a6539-234c-451d-b2a7-99cd2a6b7b2a"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:20.960479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f6a0ca09-36a9-4446-89fd-7b2081f849ba req-35d072f4-731a-4a78-b614-785c3d29d142 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:20.960999 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f6a0ca09-36a9-4446-89fd-7b2081f849ba req-35d072f4-731a-4a78-b614-785c3d29d142 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:20.971670 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-f6a0ca09-36a9-4446-89fd-7b2081f849ba req-35d072f4-731a-4a78-b614-785c3d29d142 service nova] Creating event network-changed:096a6539-234c-451d-b2a7-99cd2a6b7b2a for instance 7c58acd9-faf0-4300-9072-f415d3e63c41 on hv-cinder-83109 Mar 02 03:42:20.977180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-f6a0ca09-36a9-4446-89fd-7b2081f849ba req-35d072f4-731a-4a78-b614-785c3d29d142 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030228 Mar 02 03:42:20.977786 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 350/676] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:21.611409 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:21.612107 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:21.617297 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:21.617902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:21.624169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:21.624618 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:21.625404 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:21.630864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:21.631350 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:21.632141 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:21.632835 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:21.636124 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:21.850494 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:21.857821 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6f6473ee-e18a-43f2-9ef3-573140cc8707 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1317 microversion: 2.1 time: 0.253148 Mar 02 03:42:21.858585 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 327/677] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:21 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:21.859279 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:21.868864 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:21.869038 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4cd9f150-1b0d-4366-9074-5c0c898f0e21 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.261724 Mar 02 03:42:21.869556 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 351/678] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:21 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:21.869974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:21.875971 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:21.876426 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:21.877210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:21.877804 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:22.014245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:22.024329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:22.025827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:22.027010 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-95e255ce-55c3-4c22-bf39-2f34df2243b0 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.163356 Mar 02 03:42:22.038514 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 328/679] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:21 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:22.875134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:22.875754 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:22.882906 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:22.883389 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:22.884177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:22.884607 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:22.887081 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:22.887746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:22.893920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:22.894372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:22.895954 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:22.896405 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:23.086327 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:23.090449 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:23.093643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-59bfef0c-89d2-40ca-85d7-1daea793b193 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1317 microversion: 2.1 time: 0.222355 Mar 02 03:42:23.094211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 352/680] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:22 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:23.097880 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8081ad0f-1c20-44dc-a7a2-fa73acc1c2bc tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.214693 Mar 02 03:42:23.103330 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 329/681] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:22 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:23.103497 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:23.103497 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:23.105033 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:23.105482 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:23.106253 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:23.106685 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:23.241943 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:23.250010 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:23.251531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:23.252672 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0c199449-7961-4cef-be81-68fe8e03c22e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.157563 Mar 02 03:42:23.253226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 353/682] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:23 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:23.704842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-2d4cf750-1a6d-4df7-a90b-e2be9fda5584 req-aba1af9a-bd23-490f-96a5-7d524536fba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3769a4-1a43-4f3f-8010-3b262309cd49", "name": "network-vif-plugged", "status": "completed", "tag": "930cbda3-c8e7-4fe1-807c-ef20deab0155"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:23.713329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-2d4cf750-1a6d-4df7-a90b-e2be9fda5584 req-aba1af9a-bd23-490f-96a5-7d524536fba4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:23.713755 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-2d4cf750-1a6d-4df7-a90b-e2be9fda5584 req-aba1af9a-bd23-490f-96a5-7d524536fba4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:23.725676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-2d4cf750-1a6d-4df7-a90b-e2be9fda5584 req-aba1af9a-bd23-490f-96a5-7d524536fba4 service nova] Creating event network-vif-plugged:930cbda3-c8e7-4fe1-807c-ef20deab0155 for instance 3a3769a4-1a43-4f3f-8010-3b262309cd49 on hv-cinder-83109 Mar 02 03:42:23.730494 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-2d4cf750-1a6d-4df7-a90b-e2be9fda5584 req-aba1af9a-bd23-490f-96a5-7d524536fba4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029463 Mar 02 03:42:23.731157 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 330/683] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:24.110145 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:24.110755 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:24.116447 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:24.117729 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:24.117881 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:24.118175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:24.118949 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:24.119513 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:24.123800 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:24.124248 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:24.125021 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:24.125472 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:24.315967 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:24.323991 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c414f7c8-e361-4dad-8614-8ab0e698824e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1317 microversion: 2.1 time: 0.217628 Mar 02 03:42:24.324560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 354/684] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:24 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:24.330996 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:24.331411 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:24.331411 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:24.333977 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dd8c0a2e-ecd1-4a13-b49a-2a8b2ffdeb60 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.222777 Mar 02 03:42:24.334729 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 331/685] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:24 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:24.335788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:24.336241 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:24.337052 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:24.337489 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:24.468931 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:24.478006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:24.479536 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:24.480714 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-72f44f79-bc28-4e3c-aae2-bffbd6a6a757 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.155186 Mar 02 03:42:24.481278 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 355/686] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:24 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:25.341191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:25.341838 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:25.348245 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.348697 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.349766 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.349965 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.351510 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:25.352179 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:25.358273 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.358723 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.359529 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.359968 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.551503 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:25.555343 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:25.559481 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1c1ad636-eacc-4543-acc0-73af3dcf8d64 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1507 microversion: 2.1 time: 0.222142 Mar 02 03:42:25.560141 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 332/687] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:25 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:25.562870 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-af9dfa79-be00-4219-b4bd-43f7545991b8 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.215570 Mar 02 03:42:25.563630 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 356/688] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:25 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:25.565402 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:25.566001 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:25.573222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.573677 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.574459 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.574924 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.576452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "066365f3-bb2a-41f4-9707-8c9980cd39b8"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:25.577564 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:25.583303 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.583826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.584608 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.585039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.660948 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] HTTP exception thrown: Invalid volume: volume 066365f3-bb2a-41f4-9707-8c9980cd39b8 is already attached to instances: 2ebc0d82-0774-42a6-b910-159a48380ac9 Mar 02 03:42:25.661615 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Returning 400 to user: Invalid volume: volume 066365f3-bb2a-41f4-9707-8c9980cd39b8 is already attached to instances: 2ebc0d82-0774-42a6-b910-159a48380ac9 {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:42:25.662550 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7134ddc7-b67c-4825-b612-56be21c642f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089859 Mar 02 03:42:25.663135 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 357/689] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:42:25 2022] POST /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 02 03:42:25.715067 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:25.722825 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:25.723272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:25.723420 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:25.724907 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:25.726082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7b82dd25-14d1-45fe-a4e0-3a3ebb3822b2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.164314 Mar 02 03:42:25.726662 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 333/690] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:25 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:25.730220 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.730675 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.731518 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.731963 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.809225 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lazy-loading 'services' on Instance uuid 2ebc0d82-0774-42a6-b910-159a48380ac9 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:42:25.878369 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7a4d6614-7c87-4241-8c5b-2d06b078d3ab tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments/066365f3-bb2a-41f4-9707-8c9980cd39b8" status: 202 len: 0 microversion: 2.1 time: 0.159204 Mar 02 03:42:25.879039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 358/691] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:42:25 2022] DELETE /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments/066365f3-bb2a-41f4-9707-8c9980cd39b8 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:42:25.887575 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f58360e8-9af3-4a61-abe3-a03799f41cf3 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:25.888613 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f58360e8-9af3-4a61-abe3-a03799f41cf3 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:25.895842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f58360e8-9af3-4a61-abe3-a03799f41cf3 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.896379 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f58360e8-9af3-4a61-abe3-a03799f41cf3 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.897383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f58360e8-9af3-4a61-abe3-a03799f41cf3 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:25.897979 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f58360e8-9af3-4a61-abe3-a03799f41cf3 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:25.929294 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f58360e8-9af3-4a61-abe3-a03799f41cf3 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Mar 02 03:42:25.929881 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 334/692] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:42:25 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:26.581512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:26.582235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:26.589689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:26.590143 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:26.590921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:26.591387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:26.726162 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:26.733384 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a9288c21-9412-43e2-bf28-9f594d79f6be tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.156056 Mar 02 03:42:26.733939 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 359/693] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:26 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:26.744295 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:26.744934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:26.751374 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:26.751826 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:26.752612 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:26.753048 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:26.893432 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:26.901690 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:26.903229 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:26.904389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-fde777e0-90bc-4511-8bc1-079527dcb0f7 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.164145 Mar 02 03:42:26.904951 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 335/694] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:26 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:26.940099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-42e5bb1e-473c-4f55-bbc4-ccec06ed5c23 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:26.941037 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-42e5bb1e-473c-4f55-bbc4-ccec06ed5c23 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:26.947303 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-42e5bb1e-473c-4f55-bbc4-ccec06ed5c23 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:26.947754 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-42e5bb1e-473c-4f55-bbc4-ccec06ed5c23 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:26.948935 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-42e5bb1e-473c-4f55-bbc4-ccec06ed5c23 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:26.950785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-42e5bb1e-473c-4f55-bbc4-ccec06ed5c23 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:26.980007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-42e5bb1e-473c-4f55-bbc4-ccec06ed5c23 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043973 Mar 02 03:42:26.980565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 360/695] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:42:26 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:42:27.079993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1906993596", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "04f05bf1-583d-4ef5-b234-c4a1f3c712fb"}]}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:27.129348 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] validate_networks() for [('04f05bf1-583d-4ef5-b234-c4a1f3c712fb', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:42:27.490503 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:42:27.490920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:42:27.491405 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:42:27.491804 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:42:27.492231 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:42:27.500576 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:27.501017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:27.501809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:27.502235 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:27.518462 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:42:27.522273 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for user 542f04063676401fbb11fbd78bf26145 and project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:42:27.532713 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:42:27.534939 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:42:27.564139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-c3e46045-95ad-4493-b953-d1ef2a558d4a req-20cea6b1-bd6f-48bb-9317-bcf6374ad1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339a8aac-b54d-4b5e-9963-b2d6282de477", "name": "network-vif-plugged", "status": "completed", "tag": "4ba0ee61-14d5-4764-9f25-5df359f9822b"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:27.574240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-c3e46045-95ad-4493-b953-d1ef2a558d4a req-20cea6b1-bd6f-48bb-9317-bcf6374ad1e2 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:27.574686 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-c3e46045-95ad-4493-b953-d1ef2a558d4a req-20cea6b1-bd6f-48bb-9317-bcf6374ad1e2 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:27.583418 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-00f70c88-d309-4870-9eb9-9f1c1d5ec468 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507085 Mar 02 03:42:27.584251 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 336/696] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:42:27.586618 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-c3e46045-95ad-4493-b953-d1ef2a558d4a req-20cea6b1-bd6f-48bb-9317-bcf6374ad1e2 service nova] Creating event network-vif-plugged:4ba0ee61-14d5-4764-9f25-5df359f9822b for instance 339a8aac-b54d-4b5e-9963-b2d6282de477 on hv-cinder-83109 Mar 02 03:42:27.592038 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-c3e46045-95ad-4493-b953-d1ef2a558d4a req-20cea6b1-bd6f-48bb-9317-bcf6374ad1e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031502 Mar 02 03:42:27.592956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 361/697] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:42:27.594336 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6fac9c41-4ad0-4be4-af75-20066f36acb8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:27.594947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6fac9c41-4ad0-4be4-af75-20066f36acb8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:27.659445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6fac9c41-4ad0-4be4-af75-20066f36acb8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:27.669863 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6fac9c41-4ad0-4be4-af75-20066f36acb8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1218 microversion: 2.1 time: 0.079877 Mar 02 03:42:27.678906 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 337/698] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:27 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:27.750994 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:27.751850 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:27.758918 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:27.759480 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:27.760338 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:27.760942 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:27.914395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:27.922459 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-831a80d3-9877-4349-be8a-87b00ba8fc65 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.176564 Mar 02 03:42:27.923586 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 362/699] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:27 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:27.925003 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:27.925690 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:27.933915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:27.934375 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:27.935186 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:27.935626 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:28.082485 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:28.092004 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:28.093895 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:28.095154 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d12c9998-99cc-4cf8-b2d8-5758ebf3c28f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.174505 Mar 02 03:42:28.095750 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 338/700] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:27 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:28.687043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:28.687681 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:28.694536 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:28.694994 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:28.696050 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:28.696491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:28.754771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:28.762527 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c8179023-66eb-46d6-b3a9-738f6a0ea2cf tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1270 microversion: 2.1 time: 0.079349 Mar 02 03:42:28.763180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 363/701] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:28 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:28.940438 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:28.940974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:28.947576 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:28.948040 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:28.948815 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:28.949253 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:29.087696 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:29.095669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-66f0dbe1-b193-4375-b8bc-afafb31a7f58 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.159230 Mar 02 03:42:29.096242 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 339/702] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:28 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:29.114433 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:29.114433 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:29.120658 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:29.121092 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:29.121883 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:29.122323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:29.346807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:29.355712 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:29.357219 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:29.358398 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4a294268-da74-459c-97a3-169dddbb7f15 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.248784 Mar 02 03:42:29.358962 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 364/703] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:29 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:42:29.629442 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-fe622381-8eff-445b-95b1-59b03f184ec5 req-760f474c-42de-45f4-b93e-bb2887ace5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3", "name": "network-vif-plugged", "status": "completed", "tag": "56da13d2-0bb5-44a6-b8fd-97adb1a22f9e"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:29.639505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-fe622381-8eff-445b-95b1-59b03f184ec5 req-760f474c-42de-45f4-b93e-bb2887ace5cb service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:29.640249 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-fe622381-8eff-445b-95b1-59b03f184ec5 req-760f474c-42de-45f4-b93e-bb2887ace5cb service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:29.660640 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-fe622381-8eff-445b-95b1-59b03f184ec5 req-760f474c-42de-45f4-b93e-bb2887ace5cb service nova] Creating event network-vif-plugged:56da13d2-0bb5-44a6-b8fd-97adb1a22f9e for instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 on hv-cinder-83109 Mar 02 03:42:29.667126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-fe622381-8eff-445b-95b1-59b03f184ec5 req-760f474c-42de-45f4-b93e-bb2887ace5cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042522 Mar 02 03:42:29.667980 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 340/704] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:42:29.779684 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:29.780301 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:29.786787 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:29.787301 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:29.788103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:29.788547 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:30.086310 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:30.097060 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-edc7ad65-dc3d-43aa-a247-d37e7aade3e1 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1318 microversion: 2.1 time: 0.321018 Mar 02 03:42:30.098239 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 365/705] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:29 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:30.114224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:30.116200 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:30.123084 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:30.123756 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:30.124736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:30.125362 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:30.377305 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:30.377639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:30.378707 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:30.385059 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-126c7ba1-41f2-45dd-99d2-b2d299058d0a tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.275344 Mar 02 03:42:30.385324 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:30.385632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 341/706] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:30 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:30.385772 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:30.386854 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:30.387315 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:30.644094 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:30.652550 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:30.654056 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:30.655251 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-cf8408a6-8197-40fb-9113-0c0dc8b48f02 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1807 microversion: 2.20 time: 0.282016 Mar 02 03:42:30.655810 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 366/707] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:30 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:30.750648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-8accea38-ebac-460c-943a-0c389447a848 req-f42dda5c-2f1c-487d-9a73-f00f4e7a4f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cedef6de-e4b7-4009-a5b1-ed665db9b7b8", "tag": "66e24661-b271-40ba-a897-e667b45d2143"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:30.759090 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-8accea38-ebac-460c-943a-0c389447a848 req-f42dda5c-2f1c-487d-9a73-f00f4e7a4f44 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:30.759541 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-8accea38-ebac-460c-943a-0c389447a848 req-f42dda5c-2f1c-487d-9a73-f00f4e7a4f44 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:30.783859 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-8accea38-ebac-460c-943a-0c389447a848 req-f42dda5c-2f1c-487d-9a73-f00f4e7a4f44 service nova] Creating event network-changed:66e24661-b271-40ba-a897-e667b45d2143 for instance cedef6de-e4b7-4009-a5b1-ed665db9b7b8 on hv-cinder-83109 Mar 02 03:42:30.788474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-8accea38-ebac-460c-943a-0c389447a848 req-f42dda5c-2f1c-487d-9a73-f00f4e7a4f44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041567 Mar 02 03:42:30.789064 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 342/708] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:31.116414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:31.117022 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:31.123192 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:31.123643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:31.124414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:31.124847 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:31.307033 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:31.314268 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c4099f5d-260a-42c5-959c-0ee59aa1e45a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1318 microversion: 2.1 time: 0.201778 Mar 02 03:42:31.314860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 367/709] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:31 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:31.403227 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:31.403956 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:31.409974 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:31.410424 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:31.411233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:31.411669 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:31.579961 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:31.587506 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3fca85a0-288c-4edc-a721-0b3eabdc6bcf tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1575 microversion: 2.1 time: 0.188934 Mar 02 03:42:31.588083 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 343/710] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:31 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:31.674009 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:31.674621 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:31.681077 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:31.681531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:31.682314 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:31.682755 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:31.916204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:31.924536 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:31.926036 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:31.927230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-77a94816-ccd6-48f0-8503-785c84fce929 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1794 microversion: 2.20 time: 0.257125 Mar 02 03:42:31.927799 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 368/711] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:42:31 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1794 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:42:32.332699 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:32.333226 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:32.339024 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:32.339504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:32.340261 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:32.340691 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:32.469883 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:32.478079 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-29705423-dda8-45cf-9c66-b8c45e5eb00f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1318 microversion: 2.1 time: 0.149374 Mar 02 03:42:32.478638 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 344/712] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:32 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:32.604610 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:32.605144 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:32.611365 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:32.611807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:32.612574 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:32.613007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:32.746701 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:32.754157 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-71872d1a-96d5-4bc9-9535-66759ecd8961 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1562 microversion: 2.1 time: 0.153581 Mar 02 03:42:32.754735 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 369/713] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:32 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:33.495548 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:33.496765 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:33.503566 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:33.504190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:33.505071 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:33.505601 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:33.642820 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:33.651217 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-00adf029-44d7-4211-8122-adaa134504ba tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1318 microversion: 2.1 time: 0.159555 Mar 02 03:42:33.651809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 345/714] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:33 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:34.668098 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:34.668741 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:34.674912 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:34.675392 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:34.676159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:34.676591 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:34.808201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:34.815368 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-734a1a99-20cf-4f84-8e8c-e1f34f92e96a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1318 microversion: 2.1 time: 0.151160 Mar 02 03:42:34.815931 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 370/715] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:34 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:35.625656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-388bb70d-abec-414b-8810-91f7d022a67e req-e249fbac-8aa8-4ef9-bfc5-8b5403e9db9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedef6de-e4b7-4009-a5b1-ed665db9b7b8", "name": "network-vif-plugged", "status": "completed", "tag": "66e24661-b271-40ba-a897-e667b45d2143"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:35.635390 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-388bb70d-abec-414b-8810-91f7d022a67e req-e249fbac-8aa8-4ef9-bfc5-8b5403e9db9b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:35.635837 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-388bb70d-abec-414b-8810-91f7d022a67e req-e249fbac-8aa8-4ef9-bfc5-8b5403e9db9b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:35.649023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-388bb70d-abec-414b-8810-91f7d022a67e req-e249fbac-8aa8-4ef9-bfc5-8b5403e9db9b service nova] Creating event network-vif-plugged:66e24661-b271-40ba-a897-e667b45d2143 for instance cedef6de-e4b7-4009-a5b1-ed665db9b7b8 on hv-cinder-83109 Mar 02 03:42:35.654233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-388bb70d-abec-414b-8810-91f7d022a67e req-e249fbac-8aa8-4ef9-bfc5-8b5403e9db9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 Mar 02 03:42:35.655386 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 346/716] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:35.832607 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:35.833225 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:35.840343 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:35.840796 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:35.841593 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:35.842030 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:36.002192 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:36.010010 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-31c3b7c4-097c-4330-bea5-5fcf53f5c0b5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1318 microversion: 2.1 time: 0.181314 Mar 02 03:42:36.010577 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 371/717] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:35 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:37.028917 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:37.029627 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:37.035897 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:37.036350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:37.037791 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:37.038222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:37.174372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:37.183676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-df0a6280-bac9-4b11-beab-932b3787bb80 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1318 microversion: 2.1 time: 0.159475 Mar 02 03:42:37.184232 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 347/718] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:37 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:38.200384 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:38.201000 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:38.207345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:38.207799 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:38.208576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:38.209018 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:38.339161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:38.346396 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-249c4619-f404-4f35-ae5e-7bbd77b801c2 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1509 microversion: 2.1 time: 0.149857 Mar 02 03:42:38.346956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 372/719] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:38 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:42:39.653456 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-afd7b719-2af6-4593-a682-8b9bd0611a9f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecb7250e-a29f-4b04-9453-94cfbbc6b248"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:39.654491 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-afd7b719-2af6-4593-a682-8b9bd0611a9f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:39.660686 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd7b719-2af6-4593-a682-8b9bd0611a9f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:39.661108 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd7b719-2af6-4593-a682-8b9bd0611a9f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:39.661873 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd7b719-2af6-4593-a682-8b9bd0611a9f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:39.662337 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-afd7b719-2af6-4593-a682-8b9bd0611a9f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:39.921769 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-afd7b719-2af6-4593-a682-8b9bd0611a9f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272079 Mar 02 03:42:39.922365 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 348/720] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:42:39 2022] POST /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:47.384407 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecb7250e-a29f-4b04-9453-94cfbbc6b248"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:47.385542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:47.392078 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:47.392531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:47.393307 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:47.393772 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:47.469427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] HTTP exception thrown: Invalid volume: volume ecb7250e-a29f-4b04-9453-94cfbbc6b248 is already attached to instances: cedef6de-e4b7-4009-a5b1-ed665db9b7b8 Mar 02 03:42:47.470072 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Returning 400 to user: Invalid volume: volume ecb7250e-a29f-4b04-9453-94cfbbc6b248 is already attached to instances: cedef6de-e4b7-4009-a5b1-ed665db9b7b8 {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:42:47.470955 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-cee43aa0-f9bf-4f85-b97d-5b08e32a5b2d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090977 Mar 02 03:42:47.471542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 373/721] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:42:47 2022] POST /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:42:47.529746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:47.530334 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:47.536343 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:47.536736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:47.538648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:47.539408 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:47.617351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lazy-loading 'services' on Instance uuid cedef6de-e4b7-4009-a5b1-ed665db9b7b8 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:42:47.687108 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0c8f1d8b-282b-403d-a5c9-b9874bd08d4d tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments/ecb7250e-a29f-4b04-9453-94cfbbc6b248" status: 202 len: 0 microversion: 2.1 time: 0.161804 Mar 02 03:42:47.687894 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 349/722] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:42:47 2022] DELETE /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments/ecb7250e-a29f-4b04-9453-94cfbbc6b248 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:42:47.697358 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-473717a3-ab51-4447-989f-a30e4ebf8c81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:47.698474 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-473717a3-ab51-4447-989f-a30e4ebf8c81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:47.704355 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-473717a3-ab51-4447-989f-a30e4ebf8c81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:47.704797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-473717a3-ab51-4447-989f-a30e4ebf8c81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:47.705577 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-473717a3-ab51-4447-989f-a30e4ebf8c81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:47.706012 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-473717a3-ab51-4447-989f-a30e4ebf8c81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:47.739423 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-473717a3-ab51-4447-989f-a30e4ebf8c81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047256 Mar 02 03:42:47.739966 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 374/723] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:42:47 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:42:48.752717 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9c858b49-fd98-41da-8696-00e543480014 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:48.753831 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9c858b49-fd98-41da-8696-00e543480014 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:48.761785 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9c858b49-fd98-41da-8696-00e543480014 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:48.762234 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9c858b49-fd98-41da-8696-00e543480014 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:48.763028 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9c858b49-fd98-41da-8696-00e543480014 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:48.763495 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9c858b49-fd98-41da-8696-00e543480014 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:48.801366 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9c858b49-fd98-41da-8696-00e543480014 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053961 Mar 02 03:42:48.801945 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 350/724] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:42:48 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 02 03:42:48.908787 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1263609851", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "04f05bf1-583d-4ef5-b234-c4a1f3c712fb"}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:48.961597 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] validate_networks() for [('04f05bf1-583d-4ef5-b234-c4a1f3c712fb', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:42:49.366559 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:42:49.366986 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:42:49.367527 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:42:49.367955 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:42:49.368368 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:42:49.376953 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:49.377395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:49.378277 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:49.378714 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:49.395205 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:42:49.399689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Getting quotas for user 542f04063676401fbb11fbd78bf26145 and project 2d19eadd11624dceaf77a67791796392. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:42:49.411261 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:42:49.413687 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:42:49.459697 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e62b2c7c-5f7e-408a-a371-c17b1edd437a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554561 Mar 02 03:42:49.460340 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 375/725] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:42:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:42:49.470078 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f38834fc-5623-42cf-a9ef-4eabeebc0e31 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:49.470774 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f38834fc-5623-42cf-a9ef-4eabeebc0e31 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:49.524911 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f38834fc-5623-42cf-a9ef-4eabeebc0e31 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:49.531373 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f38834fc-5623-42cf-a9ef-4eabeebc0e31 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1218 microversion: 2.1 time: 0.065182 Mar 02 03:42:49.531934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 351/726] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:49 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:50.549426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:50.550053 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:50.557473 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:50.558173 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:50.558971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:50.559429 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:50.639341 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:50.648613 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-da428fa4-43b1-449b-b0eb-4619b8665f81 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1278 microversion: 2.1 time: 0.105110 Mar 02 03:42:50.649197 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 376/727] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:50 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:51.669710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:51.672963 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:51.685900 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:51.686434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:51.687344 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:51.687850 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:51.916756 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:51.923901 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d833a207-a29c-4b9e-8bba-9527ead04b26 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1318 microversion: 2.1 time: 0.262439 Mar 02 03:42:51.924465 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 352/728] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:51 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:52.202881 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-c878ca58-43c0-44ab-944d-7895a5c261d5 req-779978c6-8b7a-4db7-b0ee-2f790ae5f691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0eb01c6-2300-4864-a8d8-69176bd57906", "tag": "bc6f4cfd-9a40-44ac-9316-a653c451ab0a"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:52.221995 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-c878ca58-43c0-44ab-944d-7895a5c261d5 req-779978c6-8b7a-4db7-b0ee-2f790ae5f691 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:52.223333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-c878ca58-43c0-44ab-944d-7895a5c261d5 req-779978c6-8b7a-4db7-b0ee-2f790ae5f691 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:52.235617 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-c878ca58-43c0-44ab-944d-7895a5c261d5 req-779978c6-8b7a-4db7-b0ee-2f790ae5f691 service nova] Creating event network-changed:bc6f4cfd-9a40-44ac-9316-a653c451ab0a for instance d0eb01c6-2300-4864-a8d8-69176bd57906 on hv-cinder-83109 Mar 02 03:42:52.241240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-c878ca58-43c0-44ab-944d-7895a5c261d5 req-779978c6-8b7a-4db7-b0ee-2f790ae5f691 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042870 Mar 02 03:42:52.241930 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 377/729] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:42:52.941474 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:52.942119 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:52.949714 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:52.950144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:52.950925 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:52.951394 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:53.183874 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:53.190898 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2e96675f-e099-4af7-ac99-76ad719dd658 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1318 microversion: 2.1 time: 0.253335 Mar 02 03:42:53.191505 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 353/730] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:52 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:54.209639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:54.210333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:54.216726 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:54.217176 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:54.217942 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:54.218376 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:54.350221 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:54.357870 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-80b74918-da40-411c-bc57-aa65ffee9074 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1318 microversion: 2.1 time: 0.152969 Mar 02 03:42:54.358633 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 378/731] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:54 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:55.374549 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:55.375185 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:55.382081 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:55.382527 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:55.383327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:55.383762 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:55.519835 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:55.526934 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-02a3d0ef-df4e-4b9c-842d-62c542b1f232 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1318 microversion: 2.1 time: 0.156180 Mar 02 03:42:55.527537 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 354/732] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:55 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:56.543667 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:56.544311 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:56.551014 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:56.551489 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:56.552286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:56.552721 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:56.682309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:56.689513 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0922a238-1994-4980-9950-7e682bbfeff4 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1318 microversion: 2.1 time: 0.149703 Mar 02 03:42:56.690066 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 379/733] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:56 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:57.707449 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:57.708147 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:57.714803 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:57.715279 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:57.716049 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:57.716477 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:57.785134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-f10ccf55-9372-46ad-b5ff-7de2509175bb req-d22866f4-fe10-43e7-945b-c7f3c332a4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0eb01c6-2300-4864-a8d8-69176bd57906", "name": "network-vif-plugged", "status": "completed", "tag": "bc6f4cfd-9a40-44ac-9316-a653c451ab0a"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:42:57.795439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f10ccf55-9372-46ad-b5ff-7de2509175bb req-d22866f4-fe10-43e7-945b-c7f3c332a4ea service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:57.795898 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f10ccf55-9372-46ad-b5ff-7de2509175bb req-d22866f4-fe10-43e7-945b-c7f3c332a4ea service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:57.806742 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-f10ccf55-9372-46ad-b5ff-7de2509175bb req-d22866f4-fe10-43e7-945b-c7f3c332a4ea service nova] Creating event network-vif-plugged:bc6f4cfd-9a40-44ac-9316-a653c451ab0a for instance d0eb01c6-2300-4864-a8d8-69176bd57906 on hv-cinder-83109 Mar 02 03:42:57.811774 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-f10ccf55-9372-46ad-b5ff-7de2509175bb req-d22866f4-fe10-43e7-945b-c7f3c332a4ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030294 Mar 02 03:42:57.813082 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 380/734] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:42:57.854352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:57.861900 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-961f945b-8a08-4167-94dc-07fd41352e14 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1318 microversion: 2.1 time: 0.158255 Mar 02 03:42:57.862484 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 355/735] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:57 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:42:58.879367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:42:58.880584 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:42:58.886708 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:58.887194 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:58.887976 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:42:58.888410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:42:59.024063 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:42:59.031137 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-24a82a69-aa35-47b7-8886-327b4c5cd198 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1318 microversion: 2.1 time: 0.156354 Mar 02 03:42:59.031698 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 381/736] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:42:58 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:00.047973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:00.048592 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:00.055082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:00.055535 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:00.056310 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:00.056746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:00.188854 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:00.196640 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e9040e3a-402f-42f0-9ba3-4829ef4452c9 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1509 microversion: 2.1 time: 0.152653 Mar 02 03:43:00.197194 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 356/737] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:00 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:01.502293 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d6c5bbed-3edb-48ed-9b63-d36ea78dcf10 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34d1b6f0-0c72-424b-9ce7-d824d3c9e40d"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:01.503372 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d6c5bbed-3edb-48ed-9b63-d36ea78dcf10 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:01.510099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d6c5bbed-3edb-48ed-9b63-d36ea78dcf10 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:01.510553 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d6c5bbed-3edb-48ed-9b63-d36ea78dcf10 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:01.511353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d6c5bbed-3edb-48ed-9b63-d36ea78dcf10 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:01.511788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d6c5bbed-3edb-48ed-9b63-d36ea78dcf10 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:01.767323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d6c5bbed-3edb-48ed-9b63-d36ea78dcf10 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "POST /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269170 Mar 02 03:43:01.768251 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 382/738] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Mar 2 03:43:01 2022] POST /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:09.337319 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:09.337842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:09.344002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:09.344454 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:09.345227 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:09.345660 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:09.421426 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lazy-loading 'services' on Instance uuid d0eb01c6-2300-4864-a8d8-69176bd57906 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:43:09.488492 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8075f791-09ac-426e-b580-c32205bb23b7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments/34d1b6f0-0c72-424b-9ce7-d824d3c9e40d" status: 202 len: 0 microversion: 2.1 time: 0.155235 Mar 02 03:43:09.489671 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 357/739] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Mar 2 03:43:09 2022] DELETE /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments/34d1b6f0-0c72-424b-9ce7-d824d3c9e40d => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 02 03:43:09.498918 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4811e050-cad2-47d2-a574-36d30b4129e7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:09.499936 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4811e050-cad2-47d2-a574-36d30b4129e7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:09.506182 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4811e050-cad2-47d2-a574-36d30b4129e7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:09.506631 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4811e050-cad2-47d2-a574-36d30b4129e7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:09.507435 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4811e050-cad2-47d2-a574-36d30b4129e7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:09.507956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4811e050-cad2-47d2-a574-36d30b4129e7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:09.536741 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4811e050-cad2-47d2-a574-36d30b4129e7 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Mar 02 03:43:09.537345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 383/740] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:43:09 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:10.550019 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-97d924c7-ebc9-47b1-b108-19cfdd0a47f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:10.551918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-97d924c7-ebc9-47b1-b108-19cfdd0a47f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:10.558113 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-97d924c7-ebc9-47b1-b108-19cfdd0a47f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:10.558561 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-97d924c7-ebc9-47b1-b108-19cfdd0a47f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:10.559383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-97d924c7-ebc9-47b1-b108-19cfdd0a47f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:10.559817 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-97d924c7-ebc9-47b1-b108-19cfdd0a47f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:10.589096 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-97d924c7-ebc9-47b1-b108-19cfdd0a47f5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 Mar 02 03:43:10.589570 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 358/741] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:43:10 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:11.601068 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8f08a68c-744b-4bac-84f9-e4650d4db0a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:11.601974 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8f08a68c-744b-4bac-84f9-e4650d4db0a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:11.608196 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f08a68c-744b-4bac-84f9-e4650d4db0a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:11.608649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f08a68c-744b-4bac-84f9-e4650d4db0a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:11.609422 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f08a68c-744b-4bac-84f9-e4650d4db0a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:11.609862 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f08a68c-744b-4bac-84f9-e4650d4db0a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:11.637774 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8f08a68c-744b-4bac-84f9-e4650d4db0a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041226 Mar 02 03:43:11.638329 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 384/742] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Mar 2 03:43:11 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 02 03:43:12.825265 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:12.825770 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:12.832002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:12.832470 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:12.833746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:12.834179 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:12.857753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:43:12.930326 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9240af53-0cbc-4aff-9271-7114e3cd0e54 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 204 len: 0 microversion: 2.1 time: 0.108631 Mar 02 03:43:12.931287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 359/743] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:43:12 2022] DELETE /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:43:12.939619 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:12.940239 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:12.947554 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:12.948005 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:12.948793 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:12.949232 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:13.081503 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:13.088665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-65177303-bd67-49ef-abba-0701a596e9cc tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1515 microversion: 2.1 time: 0.153230 Mar 02 03:43:13.089223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 385/744] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:12 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:14.106097 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:14.106789 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:14.113007 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:14.113461 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:14.114648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:14.115107 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:14.246513 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:14.253846 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a7810f68-bbfe-4e88-b63d-2aaac3f83a88 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1515 microversion: 2.1 time: 0.151994 Mar 02 03:43:14.255737 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 360/745] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:14 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:15.271632 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:15.272240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:15.278486 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:15.278943 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:15.279773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:15.280209 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:15.512547 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:15.519702 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-068df836-020a-4a05-83d3-843ea7b7e3d8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 200 len: 1515 microversion: 2.1 time: 0.253170 Mar 02 03:43:15.520890 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 386/746] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:15 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:15.788165 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-84c3f303-5fca-4d52-8352-103879d11c3d req-6ff68ecc-546d-42b2-b061-a802f5698c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0eb01c6-2300-4864-a8d8-69176bd57906", "name": "network-vif-deleted", "tag": "bc6f4cfd-9a40-44ac-9316-a653c451ab0a"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:15.797921 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-84c3f303-5fca-4d52-8352-103879d11c3d req-6ff68ecc-546d-42b2-b061-a802f5698c6d service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:15.799323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-84c3f303-5fca-4d52-8352-103879d11c3d req-6ff68ecc-546d-42b2-b061-a802f5698c6d service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:15.812881 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-84c3f303-5fca-4d52-8352-103879d11c3d req-6ff68ecc-546d-42b2-b061-a802f5698c6d service nova] Creating event network-vif-deleted:bc6f4cfd-9a40-44ac-9316-a653c451ab0a for instance d0eb01c6-2300-4864-a8d8-69176bd57906 on hv-cinder-83109 Mar 02 03:43:15.819780 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-84c3f303-5fca-4d52-8352-103879d11c3d req-6ff68ecc-546d-42b2-b061-a802f5698c6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035159 Mar 02 03:43:15.820576 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 361/747] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:16.537204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:16.537821 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: d0eb01c6-2300-4864-a8d8-69176bd57906] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:16.544104 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:16.544584 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:16.545367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:16.545812 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:16.559635 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] HTTP exception thrown: Instance d0eb01c6-2300-4864-a8d8-69176bd57906 could not be found. Mar 02 03:43:16.560232 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Returning 404 to user: Instance d0eb01c6-2300-4864-a8d8-69176bd57906 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:43:16.561057 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bfc83f47-4c19-441b-97ae-05974e8e625e tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906" status: 404 len: 111 microversion: 2.1 time: 0.027821 Mar 02 03:43:16.561593 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 387/748] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:16 2022] GET /compute/v2.1/servers/d0eb01c6-2300-4864-a8d8-69176bd57906 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:43:17.692770 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:17.693351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:17.699610 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:17.700054 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:17.700816 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:17.701246 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:17.724653 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:43:17.796576 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-01c4264b-5d5a-433b-90a8-d213b30e97e0 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 204 len: 0 microversion: 2.1 time: 0.108683 Mar 02 03:43:17.797257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 362/749] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:43:17 2022] DELETE /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:43:17.806111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:17.806785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:17.813195 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:17.813653 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:17.814441 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:17.814885 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:17.947591 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:17.954826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b93e6a74-b6e7-4417-83eb-4aa58b6d3c9b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1515 microversion: 2.1 time: 0.153078 Mar 02 03:43:17.955434 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 388/750] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:17 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:18.972176 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:18.972866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:18.979800 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:18.980246 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:18.981012 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:18.981439 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:19.111704 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:19.118842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-68b64ae8-4d24-456b-8542-1e67ed90762a tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1515 microversion: 2.1 time: 0.150938 Mar 02 03:43:19.119427 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 363/751] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:18 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:20.073386 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2ad9d5ec-cdd4-4dc3-a7b6-8f2d35d6828b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:20.074640 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2ad9d5ec-cdd4-4dc3-a7b6-8f2d35d6828b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:20.081469 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ad9d5ec-cdd4-4dc3-a7b6-8f2d35d6828b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.081928 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ad9d5ec-cdd4-4dc3-a7b6-8f2d35d6828b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.082879 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ad9d5ec-cdd4-4dc3-a7b6-8f2d35d6828b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.084020 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ad9d5ec-cdd4-4dc3-a7b6-8f2d35d6828b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.117800 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2ad9d5ec-cdd4-4dc3-a7b6-8f2d35d6828b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments/ff5358bd-4bde-4603-95fe-94322b558381" status: 200 len: 194 microversion: 2.20 time: 0.048710 Mar 02 03:43:20.118390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 389/752] 10.222.0.23 () {60 vars in 1453 bytes} [Wed Mar 2 03:43:20 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments/ff5358bd-4bde-4603-95fe-94322b558381 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:43:20.135038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:20.135676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:20.142018 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.142465 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.143279 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.143719 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.185904 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:20.186396 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:20.193095 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.193815 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.194906 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.195366 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.433069 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:20.440791 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1e935933-7fe6-45c3-bffc-5c15d6920fbd tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 200 len: 1515 microversion: 2.1 time: 0.309486 Mar 02 03:43:20.441450 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 364/753] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:20 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:43:20.447421 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-63d4f10e-743a-4823-9770-f953b604e238 req-56c7888d-a9a8-466d-b3f8-fd8987047d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedef6de-e4b7-4009-a5b1-ed665db9b7b8", "name": "network-vif-deleted", "tag": "66e24661-b271-40ba-a897-e667b45d2143"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:20.453051 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lazy-loading 'services' on Instance uuid 339a8aac-b54d-4b5e-9963-b2d6282de477 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:43:20.455955 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-63d4f10e-743a-4823-9770-f953b604e238 req-56c7888d-a9a8-466d-b3f8-fd8987047d60 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.456656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-63d4f10e-743a-4823-9770-f953b604e238 req-56c7888d-a9a8-466d-b3f8-fd8987047d60 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.468413 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-63d4f10e-743a-4823-9770-f953b604e238 req-56c7888d-a9a8-466d-b3f8-fd8987047d60 service nova] Creating event network-vif-deleted:66e24661-b271-40ba-a897-e667b45d2143 for instance cedef6de-e4b7-4009-a5b1-ed665db9b7b8 on hv-cinder-83109 Mar 02 03:43:20.474313 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-63d4f10e-743a-4823-9770-f953b604e238 req-56c7888d-a9a8-466d-b3f8-fd8987047d60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030397 Mar 02 03:43:20.476042 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 365/754] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:20.531445 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4bba1aa7-6024-4fc1-8db9-fb49fef5a512 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments/ff5358bd-4bde-4603-95fe-94322b558381" status: 202 len: 0 microversion: 2.20 time: 0.349147 Mar 02 03:43:20.532253 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 390/755] 10.222.0.23 () {60 vars in 1456 bytes} [Wed Mar 2 03:43:20 2022] DELETE /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments/ff5358bd-4bde-4603-95fe-94322b558381 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 02 03:43:20.542848 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dfb43d57-c033-4432-b698-7cb38ac5725f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:20.544028 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dfb43d57-c033-4432-b698-7cb38ac5725f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:20.558432 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfb43d57-c033-4432-b698-7cb38ac5725f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.558947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfb43d57-c033-4432-b698-7cb38ac5725f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.559804 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfb43d57-c033-4432-b698-7cb38ac5725f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:20.560277 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dfb43d57-c033-4432-b698-7cb38ac5725f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:20.591110 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dfb43d57-c033-4432-b698-7cb38ac5725f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052551 Mar 02 03:43:20.591682 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 366/756] 10.222.0.23 () {60 vars in 1342 bytes} [Wed Mar 2 03:43:20 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 02 03:43:21.460451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:21.461165 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: cedef6de-e4b7-4009-a5b1-ed665db9b7b8] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:21.467595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.468044 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.468825 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.469258 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.483041 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] HTTP exception thrown: Instance cedef6de-e4b7-4009-a5b1-ed665db9b7b8 could not be found. Mar 02 03:43:21.483651 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Returning 404 to user: Instance cedef6de-e4b7-4009-a5b1-ed665db9b7b8 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:43:21.484464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e375df3e-6453-4b22-b634-900793998fe8 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8" status: 404 len: 111 microversion: 2.1 time: 0.029057 Mar 02 03:43:21.484991 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 391/757] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:21 2022] GET /compute/v2.1/servers/cedef6de-e4b7-4009-a5b1-ed665db9b7b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:43:21.493035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:21.493597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:21.499937 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.500383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.501150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.501656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.527306 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:43:21.603739 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-631a5af0-01f8-4407-b127-32ffdfd3da79 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:21.604907 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-631a5af0-01f8-4407-b127-32ffdfd3da79 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:21.606112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e92e3ec9-596b-444f-9376-0d4939acda7f tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 204 len: 0 microversion: 2.1 time: 0.116612 Mar 02 03:43:21.607115 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 367/758] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:43:21 2022] DELETE /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:43:21.612098 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-631a5af0-01f8-4407-b127-32ffdfd3da79 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.612577 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-631a5af0-01f8-4407-b127-32ffdfd3da79 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.613363 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-631a5af0-01f8-4407-b127-32ffdfd3da79 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.613799 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-631a5af0-01f8-4407-b127-32ffdfd3da79 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.614909 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:21.615633 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:21.621252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.621695 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.622490 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.622919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.643669 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-631a5af0-01f8-4407-b127-32ffdfd3da79 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045063 Mar 02 03:43:21.644211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 392/759] 10.222.0.23 () {60 vars in 1342 bytes} [Wed Mar 2 03:43:21 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:43:21.705037 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:21.705534 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:21.711310 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.711858 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.712643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.713080 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.736337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:43:21.762917 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:21.770475 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-aff58fed-1540-4653-8692-8a6c791f3487 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1513 microversion: 2.1 time: 0.159416 Mar 02 03:43:21.771195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 368/760] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:21 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:43:21.809649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-25cd430c-5415-4ab8-8c07-61632e6ef43e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 204 len: 0 microversion: 2.20 time: 0.108196 Mar 02 03:43:21.810221 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 393/761] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Mar 2 03:43:21 2022] DELETE /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 02 03:43:21.819376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:21.819990 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:21.825876 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.826361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.827182 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:21.827870 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:21.957671 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:21.965276 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:21.966775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:21.967960 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6b31beeb-c4bb-4289-a921-9a48e3684dd9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.153607 Mar 02 03:43:21.968521 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 369/762] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:21 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:22.788224 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:22.788929 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:22.795142 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:22.795599 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:22.796378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:22.796820 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:22.933644 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:22.941277 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-dca7559d-ed0c-400a-b062-53bd1d6e5c82 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1513 microversion: 2.1 time: 0.158382 Mar 02 03:43:22.941842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 394/763] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:22 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:22.985572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:22.986236 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:22.992586 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:22.993028 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:22.993806 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:22.994238 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:23.127772 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:23.136535 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:23.138061 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:23.139243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bb22e0c8-3ad4-4568-9612-d08efc962db1 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.157537 Mar 02 03:43:23.139804 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 370/764] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:22 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:23.704486 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-04c66321-5807-40b7-b735-4fc41b7a08dc req-5d1a9a4d-0a7f-4a33-84b5-1dd96d027012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3769a4-1a43-4f3f-8010-3b262309cd49", "name": "network-vif-deleted", "tag": "930cbda3-c8e7-4fe1-807c-ef20deab0155"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:23.712574 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-04c66321-5807-40b7-b735-4fc41b7a08dc req-5d1a9a4d-0a7f-4a33-84b5-1dd96d027012 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:23.713026 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-04c66321-5807-40b7-b735-4fc41b7a08dc req-5d1a9a4d-0a7f-4a33-84b5-1dd96d027012 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:23.724259 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-04c66321-5807-40b7-b735-4fc41b7a08dc req-5d1a9a4d-0a7f-4a33-84b5-1dd96d027012 service nova] Creating event network-vif-deleted:930cbda3-c8e7-4fe1-807c-ef20deab0155 for instance 3a3769a4-1a43-4f3f-8010-3b262309cd49 on hv-cinder-83109 Mar 02 03:43:23.729160 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-04c66321-5807-40b7-b735-4fc41b7a08dc req-5d1a9a4d-0a7f-4a33-84b5-1dd96d027012 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028482 Mar 02 03:43:23.729743 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 395/765] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:23.959741 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:23.960445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:23.967180 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:23.967915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:23.968795 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:23.969341 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:24.001249 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:24.001946 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:24.002288 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lazy-loading 'fault' on Instance uuid 3a3769a4-1a43-4f3f-8010-3b262309cd49 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:43:24.052233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:24.059484 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b0b9cec1-38dd-4b53-a9a6-6a105d016d0c tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 200 len: 1307 microversion: 2.1 time: 0.103807 Mar 02 03:43:24.060051 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 371/766] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:23 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:24.158336 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:24.159045 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:24.167037 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:24.167674 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:24.168462 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:24.168910 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:24.414894 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:24.423403 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:24.424895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:24.426050 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9512fb42-83dd-448b-85e9-e9a62c30e8bd tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 200 len: 1722 microversion: 2.20 time: 0.272078 Mar 02 03:43:24.426667 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 396/767] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:24 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:25.077403 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:25.078005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 3a3769a4-1a43-4f3f-8010-3b262309cd49] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:25.084533 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:25.084922 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:25.085700 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:25.086123 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:25.100137 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] HTTP exception thrown: Instance 3a3769a4-1a43-4f3f-8010-3b262309cd49 could not be found. Mar 02 03:43:25.100733 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Returning 404 to user: Instance 3a3769a4-1a43-4f3f-8010-3b262309cd49 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:43:25.101555 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0cbca360-45c0-49da-b879-64e3fd1291a5 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49" status: 404 len: 111 microversion: 2.1 time: 0.028156 Mar 02 03:43:25.102091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 372/768] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:25 2022] GET /compute/v2.1/servers/3a3769a4-1a43-4f3f-8010-3b262309cd49 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:43:25.445716 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:25.446270 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:25.452260 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:25.452807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:25.453778 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:25.454395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:25.468692 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] HTTP exception thrown: Instance 339a8aac-b54d-4b5e-9963-b2d6282de477 could not be found. Mar 02 03:43:25.469331 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Returning 404 to user: Instance 339a8aac-b54d-4b5e-9963-b2d6282de477 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:43:25.470202 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b23ce46d-8c05-4237-bbc8-4ddfb28becd4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 404 len: 111 microversion: 2.20 time: 0.029982 Mar 02 03:43:25.470751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 397/769] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:25 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:43:25.481998 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3ccc4a0b-7248-46e0-a754-87c74a24bcab tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '.version_select at 0x7fc38c5910d0>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:25.501110 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3ccc4a0b-7248-46e0-a754-87c74a24bcab tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997801100" status: 204 len: 0 microversion: 2.20 time: 0.025418 Mar 02 03:43:25.501689 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 373/770] 10.222.0.23 () {60 vars in 1261 bytes} [Wed Mar 2 03:43:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997801100 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 02 03:43:25.860553 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-c2c537bc-cbde-44cf-84ed-b6cece96e99d req-1650a549-1bef-4cae-bbb3-4cad7f39cebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339a8aac-b54d-4b5e-9963-b2d6282de477", "name": "network-vif-deleted", "tag": "4ba0ee61-14d5-4764-9f25-5df359f9822b"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:25.868720 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-c2c537bc-cbde-44cf-84ed-b6cece96e99d req-1650a549-1bef-4cae-bbb3-4cad7f39cebd service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:25.869164 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-c2c537bc-cbde-44cf-84ed-b6cece96e99d req-1650a549-1bef-4cae-bbb3-4cad7f39cebd service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:25.882343 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-c2c537bc-cbde-44cf-84ed-b6cece96e99d req-1650a549-1bef-4cae-bbb3-4cad7f39cebd service nova] Creating event network-vif-deleted:4ba0ee61-14d5-4764-9f25-5df359f9822b for instance 339a8aac-b54d-4b5e-9963-b2d6282de477 on hv-cinder-83109 Mar 02 03:43:25.891766 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-c2c537bc-cbde-44cf-84ed-b6cece96e99d req-1650a549-1bef-4cae-bbb3-4cad7f39cebd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Mar 02 03:43:25.892542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 398/771] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:26.235674 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:26.236195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:26.242914 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:26.243384 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:26.244155 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:26.244584 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:26.267874 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:43:26.357150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-945e285e-8bbf-49ee-8435-05b762248aeb tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 204 len: 0 microversion: 2.1 time: 0.125481 Mar 02 03:43:26.357726 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 374/772] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:43:26 2022] DELETE /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:43:26.366949 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:26.367817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:26.374026 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:26.374475 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:26.375467 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:26.375913 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:26.425300 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5b84917c-1ecb-45a5-9972-a5771af0d562 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'create', calling method: .version_select at 0x7fc38c4fa8b0>, body: {"keypair": {"name": "tempest-keypair-461346508"}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:26.439088 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-5b84917c-1ecb-45a5-9972-a5771af0d562 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:43:26.443133 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-5b84917c-1ecb-45a5-9972-a5771af0d562 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for user c3aa2415a0a1430686ee1e519c02bef0 and project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:43:26.513034 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:26.521017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b8610b6a-ed5a-4154-88eb-9959af678d21 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1514 microversion: 2.1 time: 0.158325 Mar 02 03:43:26.521675 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 399/773] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:26 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:26.824176 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-5b84917c-1ecb-45a5-9972-a5771af0d562 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:43:26.827809 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-5b84917c-1ecb-45a5-9972-a5771af0d562 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for user c3aa2415a0a1430686ee1e519c02bef0 and project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'key_pairs'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:43:26.840445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5b84917c-1ecb-45a5-9972-a5771af0d562 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.423910 Mar 02 03:43:26.841043 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 375/774] 10.222.0.23 () {62 vars in 1198 bytes} [Wed Mar 2 03:43:26 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 425 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Mar 02 03:43:27.539419 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:27.540208 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:27.546402 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:27.546856 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:27.547668 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:27.548250 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:27.794921 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:27.802125 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-175ae224-e905-4f25-8e79-f1a63d42bf99 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1514 microversion: 2.1 time: 0.267109 Mar 02 03:43:27.802677 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 400/775] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:27 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:28.166483 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-793822998", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32368c2c-db5f-4ddd-a790-805e54143545"}], "security_groups": [{"name": "tempest-securitygroup--1254381289"}], "key_name": "tempest-keypair-461346508", "user_data": "}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:28.276916 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] validate_networks() for [('32368c2c-db5f-4ddd-a790-805e54143545', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:43:28.818481 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-cfc4c3b3-d203-4f4c-be25-06a3025221fc req-17ff42f2-8f88-436b-b546-a55bb59ae30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebc0d82-0774-42a6-b910-159a48380ac9", "name": "network-vif-deleted", "tag": "7c9d29f6-06cf-404b-b04f-94a3f6ddaa79"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:28.836838 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-cfc4c3b3-d203-4f4c-be25-06a3025221fc req-17ff42f2-8f88-436b-b546-a55bb59ae30f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:28.837314 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-cfc4c3b3-d203-4f4c-be25-06a3025221fc req-17ff42f2-8f88-436b-b546-a55bb59ae30f service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:28.848333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-cfc4c3b3-d203-4f4c-be25-06a3025221fc req-17ff42f2-8f88-436b-b546-a55bb59ae30f service nova] Creating event network-vif-deleted:7c9d29f6-06cf-404b-b04f-94a3f6ddaa79 for instance 2ebc0d82-0774-42a6-b910-159a48380ac9 on hv-cinder-83109 Mar 02 03:43:28.854726 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-cfc4c3b3-d203-4f4c-be25-06a3025221fc req-17ff42f2-8f88-436b-b546-a55bb59ae30f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041672 Mar 02 03:43:28.855353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 401/776] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:43:28.860846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:28.861545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:28.868251 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:28.868931 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:28.869717 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:28.870161 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:28.891136 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:43:28.891631 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:43:28.892100 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:43:28.892508 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:43:28.892925 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:43:28.903291 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:28.903882 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:28.904699 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:28.905136 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:28.922413 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:43:28.926626 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Getting quotas for user c3aa2415a0a1430686ee1e519c02bef0 and project 824fc95ef63948c0a7af2806aa09f0d6. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:43:28.935252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542f04063676401fbb11fbd78bf26145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d19eadd11624dceaf77a67791796392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:28.941082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:43:28.943726 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-dcc65e9d-5d70-4438-ab2d-0af4f2550599 tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 200 len: 1302 microversion: 2.1 time: 0.087076 Mar 02 03:43:28.944728 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:43:28.953269 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 402/777] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:28 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:43:28.992619 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-43c38e3d-a37e-40af-bb39-6518f6902382 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.831101 Mar 02 03:43:28.993264 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 376/778] 10.222.0.23 () {62 vars in 1187 bytes} [Wed Mar 2 03:43:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 02 03:43:29.011008 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8bccdba8-02fb-4549-a685-d6aafffc6012 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:29.012121 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8bccdba8-02fb-4549-a685-d6aafffc6012 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:29.066924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8bccdba8-02fb-4549-a685-d6aafffc6012 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:29.076031 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8bccdba8-02fb-4549-a685-d6aafffc6012 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:29.077535 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8bccdba8-02fb-4549-a685-d6aafffc6012 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:29.078678 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8bccdba8-02fb-4549-a685-d6aafffc6012 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1280 microversion: 2.20 time: 0.075598 Mar 02 03:43:29.079265 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 403/779] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:29 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:29.962687 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:29.963257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] [instance: 2ebc0d82-0774-42a6-b910-159a48380ac9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:29.969995 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:29.970448 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:29.971257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:29.971883 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:29.988115 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] HTTP exception thrown: Instance 2ebc0d82-0774-42a6-b910-159a48380ac9 could not be found. Mar 02 03:43:29.989125 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] Returning 404 to user: Instance 2ebc0d82-0774-42a6-b910-159a48380ac9 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:43:29.990077 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bcde0c04-fd5e-40cd-907c-b3dadc7a537b tempest-AttachVolumeNegativeTest-413608691 tempest-AttachVolumeNegativeTest-413608691-project] 10.222.0.23 "GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9" status: 404 len: 111 microversion: 2.1 time: 0.033244 Mar 02 03:43:29.990624 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 377/780] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:43:29 2022] GET /compute/v2.1/servers/2ebc0d82-0774-42a6-b910-159a48380ac9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:43:30.098131 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:30.099201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:30.105931 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:30.106471 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:30.108290 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:30.109170 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:30.195360 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:30.203197 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:30.204704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:30.205806 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3cde4b40-abc5-4855-a4af-a4a0a796f91a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1338 microversion: 2.20 time: 0.112709 Mar 02 03:43:30.206356 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 404/781] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:30 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:31.224901 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:31.226218 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:31.233167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:31.233614 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:31.234601 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:31.235228 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:31.470298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-5ef2da96-3d54-4ca3-9ebf-79719ccfaf69 req-13e8a682-660d-4609-a178-c77c5c751263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46556c5a-63d2-4935-8e6f-68d38bc96a02", "tag": "9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:31.477971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-5ef2da96-3d54-4ca3-9ebf-79719ccfaf69 req-13e8a682-660d-4609-a178-c77c5c751263 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:31.478826 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-5ef2da96-3d54-4ca3-9ebf-79719ccfaf69 req-13e8a682-660d-4609-a178-c77c5c751263 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:31.497154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-5ef2da96-3d54-4ca3-9ebf-79719ccfaf69 req-13e8a682-660d-4609-a178-c77c5c751263 service nova] Creating event network-changed:9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19 for instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 on hv-cinder-83109 Mar 02 03:43:31.503233 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-5ef2da96-3d54-4ca3-9ebf-79719ccfaf69 req-13e8a682-660d-4609-a178-c77c5c751263 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038243 Mar 02 03:43:31.504145 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 405/782] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:43:31.548893 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:31.561450 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:31.564644 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:31.567965 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-63fe07a3-0dc8-4ea6-a8d7-fdfa00d9a257 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1406 microversion: 2.20 time: 0.346198 Mar 02 03:43:31.569557 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 378/783] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:31 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:32.588289 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:32.589205 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:32.595527 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:32.596112 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:32.596998 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:32.597509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:32.731045 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:32.740940 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:32.742444 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:32.743580 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2bfc6234-d83f-44ee-8143-b1b079484c26 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1406 microversion: 2.20 time: 0.160497 Mar 02 03:43:32.744134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 406/784] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:32 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:33.762270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:33.762889 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:33.769401 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:33.769770 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:33.771234 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:33.771596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:33.909670 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:33.918098 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:33.919693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:33.921081 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3fd6da24-fb45-4a93-ab34-7128567b514f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1406 microversion: 2.20 time: 0.162507 Mar 02 03:43:33.921635 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 379/785] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:33 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:34.938882 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:34.939581 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:34.946175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:34.946634 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:34.947435 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:34.947868 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:35.091695 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:35.100017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:35.101519 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:35.102625 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0922d41e-4dd9-4557-b3c3-21c1485f0572 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1406 microversion: 2.20 time: 0.167605 Mar 02 03:43:35.103201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 407/786] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:34 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:36.083531 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-52f51e1d-1117-418f-9234-9a0d9587dec5 req-7b16a93e-2b30-4f8d-ad8a-1d23a8043123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46556c5a-63d2-4935-8e6f-68d38bc96a02", "name": "network-vif-plugged", "status": "completed", "tag": "9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:36.095036 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-52f51e1d-1117-418f-9234-9a0d9587dec5 req-7b16a93e-2b30-4f8d-ad8a-1d23a8043123 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:36.095659 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-52f51e1d-1117-418f-9234-9a0d9587dec5 req-7b16a93e-2b30-4f8d-ad8a-1d23a8043123 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:36.107841 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-52f51e1d-1117-418f-9234-9a0d9587dec5 req-7b16a93e-2b30-4f8d-ad8a-1d23a8043123 service nova] Creating event network-vif-plugged:9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19 for instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 on hv-cinder-83109 Mar 02 03:43:36.113085 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-52f51e1d-1117-418f-9234-9a0d9587dec5 req-7b16a93e-2b30-4f8d-ad8a-1d23a8043123 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034669 Mar 02 03:43:36.114842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 380/787] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:43:36.122208 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:36.122870 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:36.131870 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:36.132488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:36.133526 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:36.134124 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:36.291078 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:36.311451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:36.312981 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:36.314152 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-75abff0d-2621-42ef-917e-62ceb8dc7c72 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1406 microversion: 2.20 time: 0.197099 Mar 02 03:43:36.314821 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 408/788] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:36 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:37.334038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:37.334752 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:37.340818 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:37.341264 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:37.342040 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:37.342475 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:37.477797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:37.485857 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:37.487385 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:37.488805 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4328875b-96ae-45ac-b023-1e722ec6668f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1406 microversion: 2.20 time: 0.159923 Mar 02 03:43:37.489975 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 381/789] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:37 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:38.509187 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:38.509807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:38.516110 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:38.516637 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:38.517491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:38.518022 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:38.656054 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:38.664908 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:38.666406 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:43:38.667606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bb7ad6e5-2222-43a0-9883-73be6f3ea0eb tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1598 microversion: 2.20 time: 0.164005 Mar 02 03:43:38.668162 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 409/790] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:43:38 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:43:38.685618 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1a5532e1-0177-4d85-8993-3091596f8935 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:38.686161 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1a5532e1-0177-4d85-8993-3091596f8935 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:38.692323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1a5532e1-0177-4d85-8993-3091596f8935 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:38.692772 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1a5532e1-0177-4d85-8993-3091596f8935 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:38.693617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1a5532e1-0177-4d85-8993-3091596f8935 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:38.693999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1a5532e1-0177-4d85-8993-3091596f8935 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:38.779526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1a5532e1-0177-4d85-8993-3091596f8935 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097864 Mar 02 03:43:38.780298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 382/791] 10.222.0.23 () {60 vars in 1315 bytes} [Wed Mar 2 03:43:38 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:43:40.113147 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b19852ee-960e-4485-a30f-e9cdf4430859 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:43:40.115340 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b19852ee-960e-4485-a30f-e9cdf4430859 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:43:40.120592 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-8a542470-e652-45cf-a584-cadb409771ce req-4a2e4eb4-abb9-4b97-af46-f6976ab42d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46556c5a-63d2-4935-8e6f-68d38bc96a02", "tag": "9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:43:40.121378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b19852ee-960e-4485-a30f-e9cdf4430859 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:40.121829 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b19852ee-960e-4485-a30f-e9cdf4430859 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:40.122804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b19852ee-960e-4485-a30f-e9cdf4430859 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:40.123277 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b19852ee-960e-4485-a30f-e9cdf4430859 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:40.145752 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-8a542470-e652-45cf-a584-cadb409771ce req-4a2e4eb4-abb9-4b97-af46-f6976ab42d25 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:43:40.145907 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b19852ee-960e-4485-a30f-e9cdf4430859 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/ips" status: 200 len: 112 microversion: 2.20 time: 0.036330 Mar 02 03:43:40.147100 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-8a542470-e652-45cf-a584-cadb409771ce req-4a2e4eb4-abb9-4b97-af46-f6976ab42d25 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:43:40.147248 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 410/792] 10.222.0.23 () {60 vars in 1288 bytes} [Wed Mar 2 03:43:40 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/ips => generated 112 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:43:40.160286 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-8a542470-e652-45cf-a584-cadb409771ce req-4a2e4eb4-abb9-4b97-af46-f6976ab42d25 service nova] Creating event network-changed:9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19 for instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 on hv-cinder-83109 Mar 02 03:43:40.165817 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-8a542470-e652-45cf-a584-cadb409771ce req-4a2e4eb4-abb9-4b97-af46-f6976ab42d25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049387 Mar 02 03:43:40.166897 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 383/793] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:03.152124 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:03.152649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:03.155601 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-cada7527-3ea7-4b5b-89e0-b7b82c2b4c85 req-594c8c4c-5bbd-4dfa-827e-ffff3b5771c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3", "tag": "56da13d2-0bb5-44a6-b8fd-97adb1a22f9e"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:03.159301 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:03.159834 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:03.160715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:03.161230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:03.164837 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-cada7527-3ea7-4b5b-89e0-b7b82c2b4c85 req-594c8c4c-5bbd-4dfa-827e-ffff3b5771c5 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:03.165428 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-cada7527-3ea7-4b5b-89e0-b7b82c2b4c85 req-594c8c4c-5bbd-4dfa-827e-ffff3b5771c5 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:03.176260 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-cada7527-3ea7-4b5b-89e0-b7b82c2b4c85 req-594c8c4c-5bbd-4dfa-827e-ffff3b5771c5 service nova] Creating event network-changed:56da13d2-0bb5-44a6-b8fd-97adb1a22f9e for instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 on hv-cinder-83109 Mar 02 03:44:03.182292 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-cada7527-3ea7-4b5b-89e0-b7b82c2b4c85 req-594c8c4c-5bbd-4dfa-827e-ffff3b5771c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030924 Mar 02 03:44:03.182890 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 384/794] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:03.190890 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:44:03.272058 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2b859020-5539-4f4b-84a7-8197555c2876 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 204 len: 0 microversion: 2.1 time: 0.123752 Mar 02 03:44:03.272565 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 411/795] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:44:03 2022] DELETE /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:44:03.282172 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:03.282866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:03.289933 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:03.290376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:03.291189 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:03.291617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:03.432524 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:03.439798 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6e9b58e9-ba5e-4ebb-be13-20b09fe2e595 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.161849 Mar 02 03:44:03.440363 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 385/796] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:03 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:04.458675 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:04.459343 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:04.466190 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:04.466642 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:04.467465 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:04.467908 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:04.635294 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:04.642631 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f79587d8-8f31-4e7f-908c-683e74e6ed06 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1568 microversion: 2.1 time: 0.188279 Mar 02 03:44:04.644068 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 412/797] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:04 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:05.660768 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:05.661384 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:05.667618 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:05.668069 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:05.668848 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:05.669288 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:05.801850 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:05.809330 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f70ded4f-0ffc-494f-a723-2fcccb86e384 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1450 microversion: 2.1 time: 0.152467 Mar 02 03:44:05.809915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 386/798] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:05 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:06.826111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:06.826731 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:06.833077 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:06.833525 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:06.834313 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:06.834751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:06.975782 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:06.983194 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-eabc1a2c-7c39-4e63-94af-fc8a6c57d667 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1450 microversion: 2.1 time: 0.161072 Mar 02 03:44:06.983747 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 413/799] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:06 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:08.000626 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:08.001261 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:08.007705 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:08.008248 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:08.009031 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:08.009468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:08.152918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:08.160351 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-af351852-f281-4306-971d-e2a0f6152ad9 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1450 microversion: 2.1 time: 0.164509 Mar 02 03:44:08.161126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 387/800] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:07 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:09.011187 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-808d12ba-dd01-49f8-b6b4-a1ac6151c16b req-70a9cd5f-2098-4f36-b626-d3d08b8f58b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3", "name": "network-vif-deleted", "tag": "56da13d2-0bb5-44a6-b8fd-97adb1a22f9e"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:09.019588 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-808d12ba-dd01-49f8-b6b4-a1ac6151c16b req-70a9cd5f-2098-4f36-b626-d3d08b8f58b3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:09.019970 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-808d12ba-dd01-49f8-b6b4-a1ac6151c16b req-70a9cd5f-2098-4f36-b626-d3d08b8f58b3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:09.030879 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-808d12ba-dd01-49f8-b6b4-a1ac6151c16b req-70a9cd5f-2098-4f36-b626-d3d08b8f58b3 service nova] Creating event network-vif-deleted:56da13d2-0bb5-44a6-b8fd-97adb1a22f9e for instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 on hv-cinder-83109 Mar 02 03:44:09.036112 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-808d12ba-dd01-49f8-b6b4-a1ac6151c16b req-70a9cd5f-2098-4f36-b626-d3d08b8f58b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029510 Mar 02 03:44:09.036746 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 414/801] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:09.177599 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:09.178213 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:09.185144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:09.185595 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:09.186377 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:09.186811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:09.245855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebebe6f704f4102a9560210b1d5e0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70b0094f5e240b28b83102b4bab82cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:09.253064 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ad54a5c4-02b9-4cbe-aac1-242c88d91108 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 200 len: 1218 microversion: 2.1 time: 0.079311 Mar 02 03:44:09.253620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 388/802] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:09 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:10.270649 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:10.271387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] [instance: 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:10.278600 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:10.279076 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:10.279855 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:10.280302 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:10.293466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] HTTP exception thrown: Instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 could not be found. Mar 02 03:44:10.294052 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Returning 404 to user: Instance 3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:44:10.294901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c79a33d8-96c7-4862-abd1-c11e1ab457f4 tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3" status: 404 len: 111 microversion: 2.1 time: 0.028923 Mar 02 03:44:10.295471 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 415/803] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:10 2022] GET /compute/v2.1/servers/3db0e078-ebd1-4bf3-99da-2b5d03f4a9c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:44:10.457959 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-9f2692d2-426b-42c4-bcac-e40ec386f38c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] Calling method '.version_select at 0x7fc38c414f70>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:10.476668 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-9f2692d2-426b-42c4-bcac-e40ec386f38c tempest-TestShelveInstance-688126094 tempest-TestShelveInstance-688126094-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-546407427" status: 202 len: 0 microversion: 2.1 time: 0.022489 Mar 02 03:44:10.477254 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 389/804] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Mar 2 03:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-546407427 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:44:25.941542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:25.942086 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:25.949353 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:25.949806 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:25.950595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:25.951039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:25.973177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lazy-loading 'flavor' on Instance uuid 46556c5a-63d2-4935-8e6f-68d38bc96a02 {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:44:26.230028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a744e047-a503-4fc6-95bb-1943169d1c8b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/action" status: 202 len: 0 microversion: 2.20 time: 0.292230 Mar 02 03:44:26.230898 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 416/805] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Mar 2 03:44:25 2022] POST /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:44:26.239633 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:26.240252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:26.247170 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:26.247643 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:26.248429 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:26.248868 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:26.379509 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:26.388345 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:26.389833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:26.390984 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-946f29e7-0e53-4e4e-83ce-32e50133858f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.155947 Mar 02 03:44:26.391566 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 390/806] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:26 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:27.410786 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:27.411509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:27.417699 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:27.418148 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:27.418916 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:27.419382 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:27.552004 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:27.560682 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:27.562177 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:27.563364 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-94d97ee3-d12d-4584-9525-92431a914d52 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.157332 Mar 02 03:44:27.563907 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 417/807] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:27 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:27.663899 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:27.664394 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:27.670806 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:27.671286 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:27.672061 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:27.672497 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:27.696363 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:44:27.769962 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dd38ca06-ef64-433f-8f8f-743e099173b6 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 204 len: 0 microversion: 2.1 time: 0.109568 Mar 02 03:44:27.770667 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 391/808] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:44:27 2022] DELETE /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:44:27.779774 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:27.780388 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:27.786227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:27.786683 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:27.787514 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:27.787957 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:27.921001 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:27.928313 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2ccda011-28c7-402c-8355-f66f40848d5e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1578 microversion: 2.1 time: 0.153053 Mar 02 03:44:27.928864 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 418/809] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:27 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:28.582417 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:28.583139 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:28.589468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:28.589920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:28.590689 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:28.591150 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:28.723596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:28.731437 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:28.732919 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:28.734072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d2f13397-f23c-4052-8415-e53a7a0eaf4c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.155991 Mar 02 03:44:28.734619 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 392/810] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:28 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:28.885206 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:44:28.885711 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: Wed Mar 2 03:44:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:44:28.945395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:28.946290 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:28.955740 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:28.956199 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:28.956973 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:28.957413 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:29.098370 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:29.106285 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-846dcc13-adc5-4e8f-b5ab-97c20bc9e7ba tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1578 microversion: 2.1 time: 0.164459 Mar 02 03:44:29.106836 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 419/811] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:28 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:29.752967 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:29.753579 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:29.759719 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:29.760166 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:29.760947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:29.761865 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:30.120704 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:30.125051 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:30.125655 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:30.129990 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:30.130575 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:30.131782 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4896d263-2521-45b7-b451-b43bc18eef3b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.382767 Mar 02 03:44:30.132550 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 393/812] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:29 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:30.132741 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:30.133372 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:30.134337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:30.135070 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:30.233749 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:30.241074 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1993a9cb-ee98-44f9-bf1a-e3220605133a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1510 microversion: 2.1 time: 0.121279 Mar 02 03:44:30.241639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 420/813] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:30 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1510 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:30.473017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-aa38547a-067d-4a62-939c-47b017dbcbef req-61820960-abe3-4500-a3c0-09687191e2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c58acd9-faf0-4300-9072-f415d3e63c41", "name": "network-vif-deleted", "tag": "096a6539-234c-451d-b2a7-99cd2a6b7b2a"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:30.481999 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-aa38547a-067d-4a62-939c-47b017dbcbef req-61820960-abe3-4500-a3c0-09687191e2b4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:30.482371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-aa38547a-067d-4a62-939c-47b017dbcbef req-61820960-abe3-4500-a3c0-09687191e2b4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:30.493802 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-aa38547a-067d-4a62-939c-47b017dbcbef req-61820960-abe3-4500-a3c0-09687191e2b4 service nova] Creating event network-vif-deleted:096a6539-234c-451d-b2a7-99cd2a6b7b2a for instance 7c58acd9-faf0-4300-9072-f415d3e63c41 on hv-cinder-83109 Mar 02 03:44:30.498915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-aa38547a-067d-4a62-939c-47b017dbcbef req-61820960-abe3-4500-a3c0-09687191e2b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029477 Mar 02 03:44:30.500115 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 394/814] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:31.149709 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:31.150952 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:31.158025 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:31.158497 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:31.159337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:31.159783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:31.259105 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:31.260100 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:31.267645 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:31.268433 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:31.269309 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:31.269994 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:31.301486 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:31.302613 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:31.303086 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:31.303734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lazy-loading 'fault' on Instance uuid 7c58acd9-faf0-4300-9072-f415d3e63c41 {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:44:31.311609 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:31.313266 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:31.314708 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-29aeceea-0179-4af1-bb8c-13c9fca193ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.168908 Mar 02 03:44:31.315508 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 421/815] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:31 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:31.345417 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:31.353233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-269a81d9-a8f4-46ef-92a7-07508468c7ca tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 200 len: 1231 microversion: 2.1 time: 0.099220 Mar 02 03:44:31.353683 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 395/816] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:31 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:44:32.334244 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:32.334861 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:32.341165 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:32.341626 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:32.342467 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:32.342854 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:32.369933 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:32.370546 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:32.377552 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:32.378007 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:32.378792 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:32.379266 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:32.392269 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] HTTP exception thrown: Instance 7c58acd9-faf0-4300-9072-f415d3e63c41 could not be found. Mar 02 03:44:32.392864 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Returning 404 to user: Instance 7c58acd9-faf0-4300-9072-f415d3e63c41 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:44:32.393729 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7a531bf1-6bce-42e8-846f-17b473a80002 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 404 len: 111 microversion: 2.1 time: 0.027553 Mar 02 03:44:32.394262 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 396/817] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:32 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:44:32.473914 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:32.482330 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:32.483874 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:32.485062 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-cca54339-ee5b-4407-848d-3ef9e72b9793 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.154792 Mar 02 03:44:32.485631 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 422/818] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:32 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:32.487331 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-981528077", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2127554969", "security_groups": [{"name": "tempest-secgroup-smoke-1934618105"}], "block_device_mapping_v2": [{"uuid": "387b45be-6849-44cc-953c-02839a3fe5a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "53f235ea-f701-4700-a5bc-959cba0de98f"}]}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:32.598936 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] validate_networks() for [('53f235ea-f701-4700-a5bc-959cba0de98f', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:44:32.950504 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:44:32.950870 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:44:32.951385 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:44:32.951793 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:44:32.952200 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:44:32.960611 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:32.961057 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:32.961862 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:32.962298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:32.978602 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:44:32.983115 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for user a3bf8581a66d4e2aa6b86731b84b8d36 and project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:44:33.045445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:44:33.047548 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='387b45be-6849-44cc-953c-02839a3fe5a4',volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:44:33.171273 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8001fecf-1e98-48ab-b777-cb81d06725a7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.687861 Mar 02 03:44:33.172019 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 397/819] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:44:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 02 03:44:33.182195 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6c986aa9-6b62-4302-a4bb-f1c89a0220a5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:33.182808 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6c986aa9-6b62-4302-a4bb-f1c89a0220a5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:33.242198 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-6c986aa9-6b62-4302-a4bb-f1c89a0220a5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:33.248936 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6c986aa9-6b62-4302-a4bb-f1c89a0220a5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1094 microversion: 2.1 time: 0.070552 Mar 02 03:44:33.249564 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 423/820] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:33 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:33.503773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:33.504386 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:33.511001 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:33.511543 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:33.513120 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:33.513797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:33.652191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:33.660528 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:33.662021 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:33.663221 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b0b945c8-d273-424f-be5f-010906c00714 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.163522 Mar 02 03:44:33.663777 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 398/821] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:33 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:34.266033 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:34.266645 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:34.273062 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:34.273517 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:34.274291 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:34.274723 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:34.366213 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:34.373979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-8f16c86b-76f0-4832-b190-aa2b50803879 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1210 microversion: 2.1 time: 0.112153 Mar 02 03:44:34.374537 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 424/822] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:34 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:34.682181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:34.682811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:34.690153 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:34.690735 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:34.691620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:34.692057 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:35.069725 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:35.079472 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:35.080950 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:35.082338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f4dcda57-b657-4e6e-a4e6-bcabb52d5afa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.404442 Mar 02 03:44:35.082884 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 399/823] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:34 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:44:35.391738 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:35.392396 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:35.399722 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:35.400182 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:35.400972 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:35.401404 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:35.616790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:35.624174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1abd83bb-169e-4b8d-89ec-72196be392a3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.237136 Mar 02 03:44:35.624752 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 425/824] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:35 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:35.902567 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-4dd02d71-b965-4f0f-9cbd-fadec81e8366 req-3724774e-0bd5-4ec4-81e7-cc6ed31cf973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff76d222-8051-4e45-ab07-cea636f36a52", "tag": "2099cb47-e552-4b42-abfc-256c9fad06ac"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:35.917747 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-4dd02d71-b965-4f0f-9cbd-fadec81e8366 req-3724774e-0bd5-4ec4-81e7-cc6ed31cf973 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:35.918438 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-4dd02d71-b965-4f0f-9cbd-fadec81e8366 req-3724774e-0bd5-4ec4-81e7-cc6ed31cf973 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:35.932830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-4dd02d71-b965-4f0f-9cbd-fadec81e8366 req-3724774e-0bd5-4ec4-81e7-cc6ed31cf973 service nova] Creating event network-changed:2099cb47-e552-4b42-abfc-256c9fad06ac for instance ff76d222-8051-4e45-ab07-cea636f36a52 on hv-cinder-83109 Mar 02 03:44:35.938147 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-4dd02d71-b965-4f0f-9cbd-fadec81e8366 req-3724774e-0bd5-4ec4-81e7-cc6ed31cf973 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040085 Mar 02 03:44:35.938983 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 400/825] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:36.101178 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:36.101835 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:36.108893 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:36.109263 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:36.110175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:36.110626 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:36.324801 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:36.333159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:36.334654 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:36.335847 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1819a59c-5a7b-4a9b-8265-2a2582e70235 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.238730 Mar 02 03:44:36.336408 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 426/826] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:36 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:36.641825 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:36.642516 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:36.648496 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:36.648941 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:36.649706 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:36.650138 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:36.853298 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:36.861377 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d64a3584-2d9f-4976-a3d4-8f32ec4e9882 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.223839 Mar 02 03:44:36.861932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 401/827] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:36 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:37.353824 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:37.354463 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:37.360783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:37.361234 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:37.361999 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:37.362432 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:37.493210 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:37.501541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:37.503020 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:37.504196 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0c1a1f86-0d1a-4c89-8d00-782306f01be6 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.154324 Mar 02 03:44:37.504730 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 427/828] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:37 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:37.878244 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:37.878973 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:37.885195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:37.885635 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:37.886409 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:37.886848 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:38.023221 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:38.033238 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a50d80c0-225a-45de-997a-987f9ae5f0fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.158828 Mar 02 03:44:38.033796 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 402/829] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:37 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:38.522269 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:38.522869 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:38.529504 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:38.529979 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:38.530751 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:38.531215 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:38.660185 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:38.667915 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:38.669575 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:38.670733 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e3d87b9a-b8c2-4326-b839-01d1bb3ba4ee tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.152536 Mar 02 03:44:38.671322 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 428/830] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:38 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:39.050508 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:39.051147 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:39.057771 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:39.058226 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:39.059037 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:39.060032 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:39.193743 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:39.204022 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d9c4e120-0326-41f7-b713-d84ab9d03ae9 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.157521 Mar 02 03:44:39.204585 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 403/831] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:39 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:39.688838 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:39.689452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:39.695758 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:39.696464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:39.697233 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:39.697709 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:39.828231 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:39.835901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:39.837374 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:39.838520 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-206aefe3-cef4-464d-9fcf-1575eafa0588 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.153579 Mar 02 03:44:39.839085 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 429/832] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:39 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:44:40.220965 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:40.221569 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:40.227808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:40.228252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:40.229019 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:40.229450 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:40.362082 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:40.369272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-49422765-62e6-4013-9751-0ef79c8fad13 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.152214 Mar 02 03:44:40.369816 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 404/833] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:40 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:40.856953 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:40.857555 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:40.863850 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:40.864297 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:40.865068 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:40.865501 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:40.998757 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:41.006314 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:41.007827 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:41.008983 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e878e73c-35c5-4800-92d3-8a4ed461390d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.155949 Mar 02 03:44:41.009532 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 430/834] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:40 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:41.385720 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:41.386342 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:41.392589 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:41.393040 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:41.393821 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:41.394263 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:41.524567 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:41.531750 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-28612e42-8ae6-4a92-9394-a9318cbece10 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.149898 Mar 02 03:44:41.532305 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 405/835] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:41 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:42.027675 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:42.028813 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:42.035138 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:42.035614 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:42.036384 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:42.036903 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:42.170491 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:42.178220 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:42.179761 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:42.180928 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-626281ac-4008-472b-9736-c6b51f4f7a2a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1744 microversion: 2.20 time: 0.157288 Mar 02 03:44:42.181480 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 431/836] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:42 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:42.547993 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:42.548608 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:42.555091 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:42.555656 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:42.556527 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:42.557010 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:42.687811 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:42.695044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-397b8fef-4482-4803-9cfc-a5b47b6eb167 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.150928 Mar 02 03:44:42.695630 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 406/837] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:42 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:43.199790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:43.200867 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:43.207345 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:43.207803 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:43.208588 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:43.209030 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:43.339197 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:43.347471 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:43.349027 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:43.350189 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-63ab9b2f-4494-463a-bafb-0866a86e420e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1744 microversion: 2.20 time: 0.154640 Mar 02 03:44:43.350741 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 432/838] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:43 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:43.712754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:43.713398 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:43.720376 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:43.720832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:43.721615 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:43.722053 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:43.856757 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:43.864183 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-affad74b-dec1-464a-a707-cadbfa9f06d3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.155362 Mar 02 03:44:43.864741 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 407/839] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:43 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:44.368919 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:44.369531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:44.377452 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:44.377916 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:44.378767 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:44.379223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:44.536787 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:44.545606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:44.547817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:44.549385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7a0e6bf5-238a-48dd-88e0-d951ee54bc69 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.184385 Mar 02 03:44:44.551146 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 433/840] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:44 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:44:44.880794 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:44.881398 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:44.889435 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:44.890284 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:44.891419 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:44.892017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:45.056912 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:45.069958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-8a058eb6-0b71-4036-bfde-eb439e8aa5ed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.191099 Mar 02 03:44:45.070623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 408/841] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:44 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:45.568300 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:45.569034 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:45.576935 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:45.577738 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:45.578542 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:45.579308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:45.747889 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:45.756702 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:45.758369 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:45.759704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-ca2ac44f-1baf-4454-8b3e-9bf6d7b70a3d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.195319 Mar 02 03:44:45.762476 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 434/842] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:45 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:46.090306 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:46.090843 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:46.098531 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:46.102478 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:46.103654 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:46.104850 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:46.299045 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:46.311874 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-51b39022-0171-4924-9462-7fee4ef7a54e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.226302 Mar 02 03:44:46.324387 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 409/843] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:46 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:46.402642 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-bdb4d072-0014-4d0d-8b25-1d130dee2698 req-56826c13-983d-4810-8fa6-1efed65356f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46556c5a-63d2-4935-8e6f-68d38bc96a02", "name": "network-vif-plugged", "status": "completed", "tag": "9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:46.410790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-bdb4d072-0014-4d0d-8b25-1d130dee2698 req-56826c13-983d-4810-8fa6-1efed65356f9 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:46.411635 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-bdb4d072-0014-4d0d-8b25-1d130dee2698 req-56826c13-983d-4810-8fa6-1efed65356f9 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:46.423648 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-bdb4d072-0014-4d0d-8b25-1d130dee2698 req-56826c13-983d-4810-8fa6-1efed65356f9 service nova] Creating event network-vif-plugged:9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19 for instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 on hv-cinder-83109 Mar 02 03:44:46.429842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-bdb4d072-0014-4d0d-8b25-1d130dee2698 req-56826c13-983d-4810-8fa6-1efed65356f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030729 Mar 02 03:44:46.430795 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 435/844] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:46.780229 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:46.780861 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:46.786848 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:46.787335 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:46.788148 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:46.788560 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:46.947861 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:46.957143 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:46.959111 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:46.960533 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f21bcdf1-6a50-46d7-b2e0-c62333f92cdc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.184791 Mar 02 03:44:46.972425 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 410/845] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:46 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:47.341230 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:47.343497 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:47.354681 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:47.355296 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:47.356313 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:47.356901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:47.513350 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:47.522295 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-073e1b97-13c6-4ff2-a69b-c8f7cb777217 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.187881 Mar 02 03:44:47.523134 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 436/846] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:47 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:47.981745 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:47.982364 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:47.989222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:47.989882 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:47.990849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:47.991541 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:48.146255 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:48.158233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:48.159905 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:48.161338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7e3c2432-bdde-4e4b-81d6-db5e48d07c14 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.185171 Mar 02 03:44:48.172765 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 411/847] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:47 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:48.447790 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-1e73717a-7875-4557-af79-25323fc0c104 req-8710ed85-3fa2-475a-b675-4ce13ea3371c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff76d222-8051-4e45-ab07-cea636f36a52", "name": "network-vif-plugged", "status": "completed", "tag": "2099cb47-e552-4b42-abfc-256c9fad06ac"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:48.456612 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-1e73717a-7875-4557-af79-25323fc0c104 req-8710ed85-3fa2-475a-b675-4ce13ea3371c service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:48.457198 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-1e73717a-7875-4557-af79-25323fc0c104 req-8710ed85-3fa2-475a-b675-4ce13ea3371c service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:48.468490 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-1e73717a-7875-4557-af79-25323fc0c104 req-8710ed85-3fa2-475a-b675-4ce13ea3371c service nova] Creating event network-vif-plugged:2099cb47-e552-4b42-abfc-256c9fad06ac for instance ff76d222-8051-4e45-ab07-cea636f36a52 on hv-cinder-83109 Mar 02 03:44:48.474114 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-1e73717a-7875-4557-af79-25323fc0c104 req-8710ed85-3fa2-475a-b675-4ce13ea3371c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030245 Mar 02 03:44:48.477562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 437/848] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:48.540411 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:48.541027 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:48.550847 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:48.551596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:48.553126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:48.553745 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:48.705425 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:48.713007 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-af3acd63-18fd-4a27-9338-067380cfa2a1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.176433 Mar 02 03:44:48.725006 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 412/849] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:48 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:49.181190 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:49.181995 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:49.189472 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:49.190172 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:49.191042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:49.191596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:49.350851 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:49.359190 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:49.360687 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:49.361873 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-58a4f918-ff26-469b-9789-90c0ece21439 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.185452 Mar 02 03:44:49.362420 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 438/850] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:49 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:44:49.732261 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:49.733718 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:49.740600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:49.741046 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:49.741830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:49.742272 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:49.904177 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:49.918976 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a8cff552-5c74-42eb-af00-e56ddf8d26a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1266 microversion: 2.1 time: 0.190505 Mar 02 03:44:49.919602 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 413/851] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:49 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:50.381746 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:50.382359 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:50.388677 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:50.389688 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:50.390465 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:50.391141 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:50.537465 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:50.547523 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:50.549541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:50.550888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c5f6109e-5b4d-47c5-ae7c-aec3bdbda25a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.173022 Mar 02 03:44:50.561511 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 439/852] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:50 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:50.936879 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:50.937730 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:50.943773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:50.944225 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:50.945006 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:50.945445 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:51.120586 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:51.129336 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-bcf1f17d-2384-4223-8d3d-d5952a591deb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1453 microversion: 2.1 time: 0.196561 Mar 02 03:44:51.129916 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 414/853] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:50 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:51.146089 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:51.146703 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:51.153246 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:51.155944 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:51.156797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:51.157244 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:51.326541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:51.335303 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9c071a96-81cc-4dd9-b7c1-acf9b4c7d7a0 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1453 microversion: 2.1 time: 0.192899 Mar 02 03:44:51.336174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 440/854] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:44:51 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:44:51.570350 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:51.571210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:51.584534 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:51.585135 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:51.585946 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:51.586385 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:51.756851 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:51.771418 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:51.775440 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:51.776751 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4e38d28d-86ff-4f67-a383-b92dd4284a7a tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.211277 Mar 02 03:44:51.790405 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 415/855] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:51 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:52.804902 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:52.806760 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:52.814889 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:52.815568 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:52.817120 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:52.817120 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:52.995252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:53.004211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:53.008017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:53.013912 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2197c129-a6a0-4f60-8025-0d930e4c5a7c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.215428 Mar 02 03:44:53.014855 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 441/856] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:52 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:53.304589 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-b9219bac-5440-4c3a-92f8-b10163589c4b req-95f70ba0-fe33-4b06-9afc-055a4c62cfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff76d222-8051-4e45-ab07-cea636f36a52", "tag": "2099cb47-e552-4b42-abfc-256c9fad06ac"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:53.314164 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-b9219bac-5440-4c3a-92f8-b10163589c4b req-95f70ba0-fe33-4b06-9afc-055a4c62cfa4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:53.314654 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-b9219bac-5440-4c3a-92f8-b10163589c4b req-95f70ba0-fe33-4b06-9afc-055a4c62cfa4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:53.332044 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-b9219bac-5440-4c3a-92f8-b10163589c4b req-95f70ba0-fe33-4b06-9afc-055a4c62cfa4 service nova] Creating event network-changed:2099cb47-e552-4b42-abfc-256c9fad06ac for instance ff76d222-8051-4e45-ab07-cea636f36a52 on hv-cinder-83109 Mar 02 03:44:53.337499 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-b9219bac-5440-4c3a-92f8-b10163589c4b req-95f70ba0-fe33-4b06-9afc-055a4c62cfa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036452 Mar 02 03:44:53.338496 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 416/857] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:44:54.032932 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:54.033611 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:54.040086 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:54.040614 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:54.041479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:54.042010 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:54.180645 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:54.189521 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:54.191044 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:54.192242 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2b23de75-4eea-467c-a255-a86c49e97ff8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1739 microversion: 2.20 time: 0.163993 Mar 02 03:44:54.200443 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 442/858] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:54 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:55.212296 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:55.212991 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:55.219737 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:55.220178 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:55.220943 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:55.221372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:55.354210 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:55.362572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:55.364122 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:55.365284 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2fdb8fbf-e49f-4e45-9b0f-75e43bcbf092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1721 microversion: 2.20 time: 0.157604 Mar 02 03:44:55.365832 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 417/859] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:55 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:56.384069 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:56.384692 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:56.391217 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:56.391673 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:56.392457 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:56.392903 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:56.524805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:56.532630 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:56.534128 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:56.535311 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4aa4f82a-5456-4db6-9284-cc71c5ee69aa tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1721 microversion: 2.20 time: 0.155169 Mar 02 03:44:56.535869 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 443/860] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:56 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:57.553746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:57.554466 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:57.562721 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:57.563188 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:57.563963 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:57.564397 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:57.694290 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:57.702517 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:57.704059 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:57.705193 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-0368cce8-9005-443f-bafd-09702dfeb44f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1664 microversion: 2.20 time: 0.155407 Mar 02 03:44:57.705746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 418/861] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:57 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:44:57.722809 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-dc79c040-1836-4269-8586-60e8d7e58130 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b101116-a138-4c70-aeb8-906b01e3438d"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:57.723901 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-dc79c040-1836-4269-8586-60e8d7e58130 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:57.730306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc79c040-1836-4269-8586-60e8d7e58130 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:57.730763 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc79c040-1836-4269-8586-60e8d7e58130 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:57.731591 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc79c040-1836-4269-8586-60e8d7e58130 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:57.732045 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-dc79c040-1836-4269-8586-60e8d7e58130 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.162235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-dc79c040-1836-4269-8586-60e8d7e58130 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.443438 Mar 02 03:44:58.162829 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 444/862] 10.222.0.23 () {62 vars in 1363 bytes} [Wed Mar 2 03:44:57 2022] POST /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-volume_attachments => generated 188 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 02 03:44:58.270922 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2a7521a1-42a2-465d-b648-47154236812c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:58.271450 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2a7521a1-42a2-465d-b648-47154236812c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:58.277233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a7521a1-42a2-465d-b648-47154236812c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:58.277688 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a7521a1-42a2-465d-b648-47154236812c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.278468 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a7521a1-42a2-465d-b648-47154236812c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:58.278910 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2a7521a1-42a2-465d-b648-47154236812c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.464560 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-00780fa1-5559-47b1-90a3-db88d80ef529 req-f1009e1c-b51e-41f7-a260-babedc7eba3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46556c5a-63d2-4935-8e6f-68d38bc96a02", "name": "network-vif-unplugged", "status": "completed", "tag": "9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:58.473039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-00780fa1-5559-47b1-90a3-db88d80ef529 req-f1009e1c-b51e-41f7-a260-babedc7eba3b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:58.473517 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-00780fa1-5559-47b1-90a3-db88d80ef529 req-f1009e1c-b51e-41f7-a260-babedc7eba3b service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.486088 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.compute.server_external_events [req-00780fa1-5559-47b1-90a3-db88d80ef529 req-f1009e1c-b51e-41f7-a260-babedc7eba3b service nova] Unable to find a host for instance 46556c5a-63d2-4935-8e6f-68d38bc96a02. Dropping event network-vif-unplugged {{(pid=123426) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 02 03:44:58.486981 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-00780fa1-5559-47b1-90a3-db88d80ef529 req-f1009e1c-b51e-41f7-a260-babedc7eba3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026416 Mar 02 03:44:58.487602 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 445/863] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 02 03:44:58.523258 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2a7521a1-42a2-465d-b648-47154236812c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-volume_attachments/2b101116-a138-4c70-aeb8-906b01e3438d" status: 202 len: 0 microversion: 2.20 time: 0.256158 Mar 02 03:44:58.523851 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 419/864] 10.222.0.23 () {60 vars in 1456 bytes} [Wed Mar 2 03:44:58 2022] DELETE /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-volume_attachments/2b101116-a138-4c70-aeb8-906b01e3438d => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:44:58.579130 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-3af0e150-b19d-4e79-bc3b-fee1cb7c059b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:44:58.579703 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-3af0e150-b19d-4e79-bc3b-fee1cb7c059b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:58.585528 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3af0e150-b19d-4e79-bc3b-fee1cb7c059b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:58.585977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3af0e150-b19d-4e79-bc3b-fee1cb7c059b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.586779 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3af0e150-b19d-4e79-bc3b-fee1cb7c059b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:58.587257 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-3af0e150-b19d-4e79-bc3b-fee1cb7c059b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.665804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-3af0e150-b19d-4e79-bc3b-fee1cb7c059b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "POST /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/action" status: 202 len: 0 microversion: 2.20 time: 0.090951 Mar 02 03:44:58.666327 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 446/865] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Mar 2 03:44:58 2022] POST /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:44:58.674433 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:58.675076 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:58.681867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:58.682319 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.683146 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:58.683671 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:58.819392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:58.828229 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:58.829915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:44:58.831252 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-feadabfc-d54e-41f8-b4bc-c44542a6dbe9 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1672 microversion: 2.20 time: 0.160706 Mar 02 03:44:58.831889 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 420/866] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:58 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:44:59.850085 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:44:59.850842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:44:59.856689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:59.857143 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:44:59.858098 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:44:59.858545 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:00.080915 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:00.088723 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:00.090227 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:00.091425 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-b5711260-9fea-42eb-aa23-4b005e6ec092 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.245792 Mar 02 03:45:00.092011 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 447/867] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:44:59 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:01.110181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:01.111144 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:01.117920 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:01.118458 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:01.119523 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:01.120178 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:01.290233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:01.298389 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:01.299922 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:01.301078 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-45c329b3-3b76-4c72-9b41-8120cb105861 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.195275 Mar 02 03:45:01.301629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 421/868] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:01 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:02.319867 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:02.320671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:02.330110 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:02.330569 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:02.331398 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:02.331844 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:02.479123 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:02.487699 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:02.489264 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:02.490509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-2358fc3b-e008-4f13-a282-028ba4d31ccc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.174677 Mar 02 03:45:02.491117 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 448/869] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:02 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:03.509370 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:03.510645 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:03.517782 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:03.518233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:03.519023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:03.519513 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:03.657560 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:03.665501 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:03.667002 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:03.668224 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3dcc410a-d945-4c02-ba4e-10b99fe1ebd3 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.162813 Mar 02 03:45:03.668778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 422/870] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:03 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:04.688197 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:04.689021 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:04.695326 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:04.696804 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:04.697641 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:04.698087 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:05.115464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:05.123980 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:05.125848 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:05.127240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-047fff8d-a083-4c9d-922c-721a01aa970f tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.443528 Mar 02 03:45:05.127969 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 449/871] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:04 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:06.145562 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:06.146170 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:06.152551 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:06.153005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:06.153845 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:06.154287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:06.312255 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:06.321334 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:06.323234 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:06.324440 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d3647b1d-a3db-4e3e-b2f2-afccff3753a8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.182887 Mar 02 03:45:06.325065 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 423/872] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:06 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:45:07.343807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:07.344410 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:07.351806 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:07.352347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:07.353155 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:07.353596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:07.498104 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:07.508014 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:07.509503 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:07.510686 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-536a1700-3f11-4f04-8e2b-8a0d3e2a87ed tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.171304 Mar 02 03:45:07.511279 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 450/873] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:07 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:08.530857 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:08.530857 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:08.537492 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:08.537959 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:08.538760 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:08.539231 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:08.685997 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:08.694306 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:08.696086 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:08.697522 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-63a3490d-7abb-4f61-84a0-3eecbc5e498d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.171855 Mar 02 03:45:08.698072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 424/874] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:08 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:09.715875 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:09.716477 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:09.723192 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:09.723639 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:09.724414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:09.724878 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:09.855506 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:09.864478 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:09.866017 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:09.867237 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e557fc07-845d-470a-9bd6-5ce1d469c993 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.155309 Mar 02 03:45:09.867793 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 451/875] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:09 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:10.885348 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:10.885953 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:10.892434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:10.892876 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:10.893642 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:10.894072 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:11.024775 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:11.033312 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:11.034813 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:11.036035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e6ae414d-09fb-4030-b056-72d3276424b4 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.154539 Mar 02 03:45:11.036591 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 425/876] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:10 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:12.054892 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:12.055463 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:12.062671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:12.063154 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:12.063934 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:12.064375 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:12.197737 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:12.205876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:12.207390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:12.208533 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-54057fba-6d81-459c-be05-e5c3b28cebf2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.157664 Mar 02 03:45:12.209085 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 452/877] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:12 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:13.227352 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:13.227903 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:13.234715 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:13.235195 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:13.235968 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:13.236399 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:13.371019 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:13.379358 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:13.380833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:13.381982 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-48de7fdc-3753-4930-8a5f-98014775df0e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.158684 Mar 02 03:45:13.382528 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 426/878] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:13 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:14.400942 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:14.401689 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:14.408754 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:14.409218 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:14.410009 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:14.410451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:14.553282 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-4e1760c9-3a34-4069-ae52-943587fe856d req-1f21b0b9-cc24-4619-8d08-3671ad3096a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46556c5a-63d2-4935-8e6f-68d38bc96a02", "name": "network-vif-plugged", "status": "completed", "tag": "9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:45:14.566023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-4e1760c9-3a34-4069-ae52-943587fe856d req-1f21b0b9-cc24-4619-8d08-3671ad3096a3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:14.566558 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-4e1760c9-3a34-4069-ae52-943587fe856d req-1f21b0b9-cc24-4619-8d08-3671ad3096a3 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:14.578876 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-4e1760c9-3a34-4069-ae52-943587fe856d req-1f21b0b9-cc24-4619-8d08-3671ad3096a3 service nova] Creating event network-vif-plugged:9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19 for instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 on hv-cinder-83109 Mar 02 03:45:14.584165 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-4e1760c9-3a34-4069-ae52-943587fe856d req-1f21b0b9-cc24-4619-8d08-3671ad3096a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035165 Mar 02 03:45:14.585858 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 427/879] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:45:14.631832 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:14.641439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:14.642954 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:14.644340 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fe31bcb2-8e85-453e-ad80-492949af5f49 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.247329 Mar 02 03:45:14.645304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 453/880] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:14 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:15.663441 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:15.664140 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:15.671134 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:15.671603 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:15.672377 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:15.672813 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:15.806692 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:15.815521 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:15.817003 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:15.818230 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-db322aaf-dd59-465d-a4f3-d8271389982d tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1730 microversion: 2.20 time: 0.159568 Mar 02 03:45:15.818779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 428/881] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:15 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:16.836920 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:16.837533 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:16.844367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:16.844818 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:16.845628 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:16.846068 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:16.976005 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:16.984435 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:16.985948 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:16.987168 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1054316a-8588-4e6b-aeca-ffaa23830abe tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1717 microversion: 2.20 time: 0.154095 Mar 02 03:45:16.987727 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 454/882] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:16 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:50.807124 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5980aaf9-9e76-4d26-be68-2013dace942e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:50.808031 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5980aaf9-9e76-4d26-be68-2013dace942e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:50.814080 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5980aaf9-9e76-4d26-be68-2013dace942e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:50.814530 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5980aaf9-9e76-4d26-be68-2013dace942e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:50.815334 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5980aaf9-9e76-4d26-be68-2013dace942e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:50.815808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5980aaf9-9e76-4d26-be68-2013dace942e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:50.844598 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5980aaf9-9e76-4d26-be68-2013dace942e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041579 Mar 02 03:45:50.845149 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 429/883] 10.222.0.23 () {60 vars in 1342 bytes} [Wed Mar 2 03:45:50 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:45:50.900737 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:50.901245 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:50.908304 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:50.908760 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:50.909537 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:50.909977 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:50.937405 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:45:51.013788 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-cd5fe3a9-f14e-45c9-bca0-c93ee547720b tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 204 len: 0 microversion: 2.20 time: 0.116177 Mar 02 03:45:51.016075 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 455/884] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Mar 2 03:45:50 2022] DELETE /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 02 03:45:51.024074 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:51.024685 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:51.031648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:51.032104 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:51.032888 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:51.033328 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:51.174024 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:51.181695 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:51.183207 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:51.184393 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4e38ba08-f323-4a4e-8aa3-b432e7f346e8 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.164232 Mar 02 03:45:51.184947 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 430/885] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:51 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 02 03:45:52.205815 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:52.206427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:52.212714 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:52.213190 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:52.213966 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:52.214401 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:52.361191 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:52.370135 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:52.372201 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:52.373797 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1a3e8582-7491-41f1-bd15-85ab41780228 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1723 microversion: 2.20 time: 0.172690 Mar 02 03:45:52.374631 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 456/886] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:52 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:53.393465 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:53.394124 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:53.402368 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:53.402368 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:53.402368 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:53.402827 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:53.425320 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-78daf489-3333-4141-99b1-07e2c21f4b28 req-aa106206-a90d-471a-a093-05ed2ac47d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46556c5a-63d2-4935-8e6f-68d38bc96a02", "name": "network-vif-deleted", "tag": "9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:45:53.433937 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-78daf489-3333-4141-99b1-07e2c21f4b28 req-aa106206-a90d-471a-a093-05ed2ac47d76 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:53.434372 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-78daf489-3333-4141-99b1-07e2c21f4b28 req-aa106206-a90d-471a-a093-05ed2ac47d76 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:53.455362 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-78daf489-3333-4141-99b1-07e2c21f4b28 req-aa106206-a90d-471a-a093-05ed2ac47d76 service nova] Creating event network-vif-deleted:9f6d9646-0fc2-4c7c-b77c-eb9103f1bd19 for instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 on hv-cinder-83109 Mar 02 03:45:53.460501 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-78daf489-3333-4141-99b1-07e2c21f4b28 req-aa106206-a90d-471a-a093-05ed2ac47d76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040204 Mar 02 03:45:53.461139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 457/887] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:45:53.476071 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:53.484730 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:53.486540 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3aa2415a0a1430686ee1e519c02bef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824fc95ef63948c0a7af2806aa09f0d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:45:53.488623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ac7295ea-7749-477f-a62a-c979a6162ee2 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 200 len: 1655 microversion: 2.20 time: 0.098476 Mar 02 03:45:53.489495 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 431/888] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:53 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 1655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 02 03:45:54.508141 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:54.508847 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:54.517079 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:54.517538 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:54.518386 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:54.518875 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:54.532704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] HTTP exception thrown: Instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 could not be found. Mar 02 03:45:54.533339 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Returning 404 to user: Instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:45:54.534172 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-16bab766-bc53-4e81-a2d2-08691b8d0f74 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 404 len: 111 microversion: 2.20 time: 0.030894 Mar 02 03:45:54.534734 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 458/889] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:54 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:45:54.544225 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f1888a0d-cae9-43f1-84ec-a123c6e3ca6c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '.version_select at 0x7fc38c4dea60>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:54.562600 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f1888a0d-cae9-43f1-84ec-a123c6e3ca6c tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-461346508" status: 204 len: 0 microversion: 2.20 time: 0.023185 Mar 02 03:45:54.563303 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 432/890] 10.222.0.23 () {60 vars in 1258 bytes} [Wed Mar 2 03:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-461346508 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 02 03:45:56.333707 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:56.334233 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:56.340505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:56.341221 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:56.342242 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:56.342718 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:56.355464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] HTTP exception thrown: Instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 could not be found. Mar 02 03:45:56.356042 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Returning 404 to user: Instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:45:56.356846 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-0ea90a74-754a-4346-aa4f-0f08ede8b949 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 404 len: 111 microversion: 2.20 time: 0.027230 Mar 02 03:45:56.357372 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 459/891] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Mar 2 03:45:56 2022] DELETE /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:45:56.366161 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:56.366773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 46556c5a-63d2-4935-8e6f-68d38bc96a02] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:56.373215 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:56.374777 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:56.375659 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:56.376097 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:56.388446 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] HTTP exception thrown: Instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 could not be found. Mar 02 03:45:56.389027 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Returning 404 to user: Instance 46556c5a-63d2-4935-8e6f-68d38bc96a02 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:45:56.390329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-61a8d689-1c99-41e1-b275-b98caeb6f240 tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02" status: 404 len: 111 microversion: 2.20 time: 0.028518 Mar 02 03:45:56.390836 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 433/892] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:56 2022] GET /compute/v2.1/servers/46556c5a-63d2-4935-8e6f-68d38bc96a02 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:45:57.519438 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:57.519945 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:57.526099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:57.526549 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:57.527354 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:57.527795 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:57.540960 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] HTTP exception thrown: Instance 339a8aac-b54d-4b5e-9963-b2d6282de477 could not be found. Mar 02 03:45:57.541531 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Returning 404 to user: Instance 339a8aac-b54d-4b5e-9963-b2d6282de477 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:45:57.542337 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bee10aab-c83d-4f8a-8c75-12bfdf07a67e tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 404 len: 111 microversion: 2.20 time: 0.026788 Mar 02 03:45:57.542850 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 460/893] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Mar 2 03:45:57 2022] DELETE /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 02 03:45:57.551444 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:45:57.552058 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] [instance: 339a8aac-b54d-4b5e-9963-b2d6282de477] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:45:57.558418 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:57.558848 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:57.560081 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:45:57.560604 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:45:57.575495 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] HTTP exception thrown: Instance 339a8aac-b54d-4b5e-9963-b2d6282de477 could not be found. Mar 02 03:45:57.576057 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] Returning 404 to user: Instance 339a8aac-b54d-4b5e-9963-b2d6282de477 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:45:57.577356 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3eb91b26-8cdd-40a8-b2f1-f1d2598458fc tempest-AttachVolumeShelveTestJSON-1942325891 tempest-AttachVolumeShelveTestJSON-1942325891-project] 10.222.0.23 "GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477" status: 404 len: 111 microversion: 2.20 time: 0.029358 Mar 02 03:45:57.577871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 434/894] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Mar 2 03:45:57 2022] GET /compute/v2.1/servers/339a8aac-b54d-4b5e-9963-b2d6282de477 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 02 03:46:06.475359 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-941900917", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "29b7a47c-1a80-4700-8165-7ff436b30caf"}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:06.526848 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] validate_networks() for [('29b7a47c-1a80-4700-8165-7ff436b30caf', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:46:06.865221 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:46:06.865647 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:46:06.866113 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:46:06.866520 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:46:06.866926 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:46:06.875711 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:06.876159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:06.876957 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:06.877387 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:06.893650 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Getting quotas for project 606c3b4cd63d41a1876cfe423423469e. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:46:06.897466 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Getting quotas for user ad7da47f72554e6184532e3386eb1bc4 and project 606c3b4cd63d41a1876cfe423423469e. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:46:06.908498 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:46:06.910648 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:46:06.954635 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-44b16c2d-bc09-4b09-92c5-a5026d600cf6 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483080 Mar 02 03:46:06.955375 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 461/895] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:46:06.965112 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-07dcfbf5-6184-4954-8146-4d8fe17bce35 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:06.965716 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-07dcfbf5-6184-4954-8146-4d8fe17bce35 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:07.019417 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-07dcfbf5-6184-4954-8146-4d8fe17bce35 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:07.025936 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-07dcfbf5-6184-4954-8146-4d8fe17bce35 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1213 microversion: 2.1 time: 0.064672 Mar 02 03:46:07.026499 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 435/896] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:06 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:08.043247 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:08.043871 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:08.050749 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:08.051248 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:08.052054 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:08.052504 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:08.247606 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:08.255252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-a0cf3365-611c-4e5d-8406-9556eec6597c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1271 microversion: 2.1 time: 0.216851 Mar 02 03:46:08.255817 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 462/897] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:08 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:09.211732 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-d68d75e9-50af-4289-8db5-4d21ec9ada3f req-31650a88-0252-4575-8b7f-8f2a9ac37ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c32732-1990-478d-b1a6-af7b1007776a", "tag": "a7823d2d-0ea0-4401-a3af-49da72b5d443"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:09.234414 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d68d75e9-50af-4289-8db5-4d21ec9ada3f req-31650a88-0252-4575-8b7f-8f2a9ac37ee9 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:09.234867 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d68d75e9-50af-4289-8db5-4d21ec9ada3f req-31650a88-0252-4575-8b7f-8f2a9ac37ee9 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:09.245074 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-d68d75e9-50af-4289-8db5-4d21ec9ada3f req-31650a88-0252-4575-8b7f-8f2a9ac37ee9 service nova] Creating event network-changed:a7823d2d-0ea0-4401-a3af-49da72b5d443 for instance 18c32732-1990-478d-b1a6-af7b1007776a on hv-cinder-83109 Mar 02 03:46:09.250746 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-d68d75e9-50af-4289-8db5-4d21ec9ada3f req-31650a88-0252-4575-8b7f-8f2a9ac37ee9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042539 Mar 02 03:46:09.251392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 436/898] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:46:09.272702 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:09.273431 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:09.279611 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:09.280151 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:09.281028 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:09.281593 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:09.514621 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:09.522551 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-616e4c2f-2e6f-44fd-816a-c2655bf6c576 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1313 microversion: 2.1 time: 0.253719 Mar 02 03:46:09.523143 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 463/899] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:09 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:10.540155 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:10.540853 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:10.546736 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:10.547222 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:10.547998 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:10.548434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:10.689766 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:10.696981 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-dd28ebcd-1420-4d53-8b58-7188469e61ff tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1313 microversion: 2.1 time: 0.161495 Mar 02 03:46:10.697783 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 437/900] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:10 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:11.714632 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:11.715309 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:11.722103 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:11.722552 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:11.723361 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:11.723800 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:11.858006 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:11.865460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-eb883bfb-4d51-4570-a252-3f619e945803 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1313 microversion: 2.1 time: 0.154678 Mar 02 03:46:11.866012 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 464/901] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:11 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:12.881893 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:12.882513 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:12.888907 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:12.889361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:12.890190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:12.890634 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:13.023784 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:13.031833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3659a2f2-66da-4d5e-a347-2f1973242506 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1313 microversion: 2.1 time: 0.153854 Mar 02 03:46:13.032381 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 438/902] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:12 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:14.049288 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:14.049815 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:14.056085 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:14.056539 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:14.057312 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:14.057784 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:14.191994 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:14.199678 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f01f0baa-2c0a-4dc1-a56b-458218eeae2b tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1313 microversion: 2.1 time: 0.155143 Mar 02 03:46:14.200245 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 465/903] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:14 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:14.879678 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-2ae2153b-aeb2-4b6a-bfa3-64cc52021152 req-77179a15-577b-41cf-9f9b-19b7a8fa6e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c32732-1990-478d-b1a6-af7b1007776a", "name": "network-vif-plugged", "status": "completed", "tag": "a7823d2d-0ea0-4401-a3af-49da72b5d443"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:14.888048 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-2ae2153b-aeb2-4b6a-bfa3-64cc52021152 req-77179a15-577b-41cf-9f9b-19b7a8fa6e1a service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:14.888482 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-2ae2153b-aeb2-4b6a-bfa3-64cc52021152 req-77179a15-577b-41cf-9f9b-19b7a8fa6e1a service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:14.900047 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-2ae2153b-aeb2-4b6a-bfa3-64cc52021152 req-77179a15-577b-41cf-9f9b-19b7a8fa6e1a service nova] Creating event network-vif-plugged:a7823d2d-0ea0-4401-a3af-49da72b5d443 for instance 18c32732-1990-478d-b1a6-af7b1007776a on hv-cinder-83109 Mar 02 03:46:14.904911 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-2ae2153b-aeb2-4b6a-bfa3-64cc52021152 req-77179a15-577b-41cf-9f9b-19b7a8fa6e1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028927 Mar 02 03:46:14.906526 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 439/904] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:46:15.216315 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:15.216927 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:15.223243 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:15.223701 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:15.224482 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:15.224919 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:15.359566 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:15.366869 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-1e6fbfa9-76a5-4e7e-b176-1441b8171db8 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1313 microversion: 2.1 time: 0.154404 Mar 02 03:46:15.367460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 466/905] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:15 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:16.385319 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:16.386020 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:16.392516 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:16.392959 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:16.393734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:16.394169 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:16.578114 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:16.585266 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cf79d752-b6c5-4f71-b3b5-29e37d28d05c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1497 microversion: 2.1 time: 0.204729 Mar 02 03:46:16.585825 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 440/906] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:16 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:17.185204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:17.185715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:17.192523 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:17.192981 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:17.193771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:17.194220 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:17.218152 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:46:17.289765 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6bc2c6cb-129d-4636-85f8-0bd2c0b08ca5 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "DELETE /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 204 len: 0 microversion: 2.1 time: 0.108033 Mar 02 03:46:17.290395 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 467/907] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:46:17 2022] DELETE /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:46:17.299186 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:17.299805 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:17.305598 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:17.306051 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:17.306830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:17.307301 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:17.443552 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:17.451283 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e5b1a8f5-fe11-42b1-9c6c-5273f9708e3a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1503 microversion: 2.1 time: 0.156579 Mar 02 03:46:17.451842 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 441/908] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:17 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:18.468676 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:18.469385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:18.475629 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:18.476109 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:18.476908 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:18.477347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:18.611785 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:18.619095 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-eaa3e10d-9363-4c92-b016-ad2a6468abbf tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1503 microversion: 2.1 time: 0.155043 Mar 02 03:46:18.619658 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 468/909] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:18 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:19.328658 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-353f4c4d-03cb-4d13-904d-ead5860ef956 req-ee5504d4-a3ba-4e48-840d-10fe8124e9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c32732-1990-478d-b1a6-af7b1007776a", "name": "network-vif-deleted", "tag": "a7823d2d-0ea0-4401-a3af-49da72b5d443"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:19.337886 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-353f4c4d-03cb-4d13-904d-ead5860ef956 req-ee5504d4-a3ba-4e48-840d-10fe8124e9f4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:19.338257 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-353f4c4d-03cb-4d13-904d-ead5860ef956 req-ee5504d4-a3ba-4e48-840d-10fe8124e9f4 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:19.349826 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-353f4c4d-03cb-4d13-904d-ead5860ef956 req-ee5504d4-a3ba-4e48-840d-10fe8124e9f4 service nova] Creating event network-vif-deleted:a7823d2d-0ea0-4401-a3af-49da72b5d443 for instance 18c32732-1990-478d-b1a6-af7b1007776a on hv-cinder-83109 Mar 02 03:46:19.354830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-353f4c4d-03cb-4d13-904d-ead5860ef956 req-ee5504d4-a3ba-4e48-840d-10fe8124e9f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031768 Mar 02 03:46:19.355729 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 442/910] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:46:19.637096 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:19.637651 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:19.644969 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:19.645426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:19.646208 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:19.646643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:19.676426 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:19.676861 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:19.677308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lazy-loading 'fault' on Instance uuid 18c32732-1990-478d-b1a6-af7b1007776a {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:46:19.716992 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:19.724562 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7e07a479-a58d-4ec8-871b-3424f48eb35f tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 200 len: 1303 microversion: 2.1 time: 0.091471 Mar 02 03:46:19.725354 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 469/911] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:19 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:20.743126 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:20.743830 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 18c32732-1990-478d-b1a6-af7b1007776a] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:20.750457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:20.750903 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:20.751702 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:20.752140 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:20.764761 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] HTTP exception thrown: Instance 18c32732-1990-478d-b1a6-af7b1007776a could not be found. Mar 02 03:46:20.765797 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Returning 404 to user: Instance 18c32732-1990-478d-b1a6-af7b1007776a could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:46:20.766629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5f459b47-e9fd-4d95-99a1-dcdefe8fc037 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a" status: 404 len: 111 microversion: 2.1 time: 0.028227 Mar 02 03:46:20.767175 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 443/912] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:20 2022] GET /compute/v2.1/servers/18c32732-1990-478d-b1a6-af7b1007776a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:46:20.813956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1179885604", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452", "networks": [{"uuid": "29b7a47c-1a80-4700-8165-7ff436b30caf"}]}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:20.866324 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] validate_networks() for [('29b7a47c-1a80-4700-8165-7ff436b30caf', None, None, None, None, None)] {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:46:21.201769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:46:21.202228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:46:21.203336 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:46:21.203758 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:46:21.204211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:46:21.212723 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:21.213175 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:21.213988 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:21.214429 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:21.231307 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Getting quotas for project 606c3b4cd63d41a1876cfe423423469e. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:46:21.236286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Getting quotas for user ad7da47f72554e6184532e3386eb1bc4 and project 606c3b4cd63d41a1876cfe423423469e. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:46:21.246769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:46:21.249039 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:46:21.293926 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-48e0a082-cbec-4a80-84a7-cd66de2f01ce tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483746 Mar 02 03:46:21.294479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 470/913] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:46:21.305021 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d75557ee-63dc-4e39-af4b-508221582beb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:21.305748 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d75557ee-63dc-4e39-af4b-508221582beb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:21.360556 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d75557ee-63dc-4e39-af4b-508221582beb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:21.366918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d75557ee-63dc-4e39-af4b-508221582beb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1214 microversion: 2.1 time: 0.065899 Mar 02 03:46:21.367639 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 444/914] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:21 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:22.384517 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:22.385133 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:22.391310 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:22.391765 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:22.392541 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:22.392988 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:22.454135 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:22.461473 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-636abb8f-ea64-471e-a5fb-764129ab9d19 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1274 microversion: 2.1 time: 0.081312 Mar 02 03:46:22.462022 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 471/915] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:22 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:23.477617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:23.478258 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:23.485957 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:23.486398 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:23.487190 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:23.487622 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:23.548728 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:23.555884 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c7e452d7-4105-416b-a0d6-913681035c6c tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1274 microversion: 2.1 time: 0.082097 Mar 02 03:46:23.556435 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 445/916] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:23 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:24.574011 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:24.574642 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:24.581159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:24.581621 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:24.582398 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:24.582844 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:24.640659 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:24.647805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7452e136-2b00-419f-8146-5c2d3cf35947 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1274 microversion: 2.1 time: 0.077932 Mar 02 03:46:24.648366 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 472/917] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:24 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1274 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:25.664822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:25.665374 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:25.672146 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:25.672502 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:25.673488 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:25.674089 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:25.808314 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:25.816311 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-42acb402-0408-4edf-8553-7f4f99f348eb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1314 microversion: 2.1 time: 0.155495 Mar 02 03:46:25.817275 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 446/918] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:25 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:25.979971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-cdeb20a4-c62d-4b70-ad2d-beaef17d19ed req-f47bb1cf-162a-4a8b-8294-26773e8a072e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8670385d-2f82-4976-a782-5a8c4d5527dd", "tag": "dc04b975-c768-4e00-bb9d-11a1f8c1fa5c"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:25.989022 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-cdeb20a4-c62d-4b70-ad2d-beaef17d19ed req-f47bb1cf-162a-4a8b-8294-26773e8a072e service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:25.989507 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-cdeb20a4-c62d-4b70-ad2d-beaef17d19ed req-f47bb1cf-162a-4a8b-8294-26773e8a072e service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:26.002570 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-cdeb20a4-c62d-4b70-ad2d-beaef17d19ed req-f47bb1cf-162a-4a8b-8294-26773e8a072e service nova] Creating event network-changed:dc04b975-c768-4e00-bb9d-11a1f8c1fa5c for instance 8670385d-2f82-4976-a782-5a8c4d5527dd on hv-cinder-83109 Mar 02 03:46:26.007700 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-cdeb20a4-c62d-4b70-ad2d-beaef17d19ed req-f47bb1cf-162a-4a8b-8294-26773e8a072e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031374 Mar 02 03:46:26.008389 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 473/919] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:46:26.834095 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:26.834711 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:26.841046 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:26.841530 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:26.842311 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:26.842748 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:26.976688 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:26.983882 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-ef11ee2d-114a-459c-9d03-70abb690c101 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1314 microversion: 2.1 time: 0.153645 Mar 02 03:46:26.984514 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 447/920] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:26 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:28.001807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:28.002504 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:28.008783 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:28.009237 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:28.010010 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:28.010449 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:28.140983 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:28.148216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d28ddc59-0cf4-4627-9506-2e54344e3f46 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1314 microversion: 2.1 time: 0.151161 Mar 02 03:46:28.148771 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 474/921] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:27 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:28.674494 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1158152566", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2127554969", "security_groups": [{"name": "tempest-secgroup-smoke-1934618105"}], "block_device_mapping_v2": [{"uuid": "d3b9aa0b-e4bf-4579-8957-89ae3d1d84ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "53f235ea-f701-4700-a5bc-959cba0de98f"}]}} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:28.783308 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.network.neutron [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] validate_networks() for [('53f235ea-f701-4700-a5bc-959cba0de98f', None, None, None, None, None)] {{(pid=123425) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:46:29.165343 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:29.165803 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Flavor limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:46:29.165803 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Image limits 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:46:29.165990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:29.166208 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Flavor pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:46:29.167243 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Image pref 0:0:0 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:46:29.167708 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.virt.hardware [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:46:29.173645 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:29.174107 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:29.174962 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:29.175430 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:29.176927 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:29.177371 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:29.178168 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:29.178592 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:29.194945 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:46:29.199214 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.quota [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Getting quotas for user a3bf8581a66d4e2aa6b86731b84b8d36 and project c1f83d7fe62a4fca8328d978322a3cca. Resources: {'instances', 'ram', 'cores'} {{(pid=123425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:46:29.255899 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Going to run 1 instances... {{(pid=123425) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:46:29.258069 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3b9aa0b-e4bf-4579-8957-89ae3d1d84ee',volume_size=None,volume_type=None)] {{(pid=123425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:46:29.318367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:29.327958 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4a435b94-9a6a-43c2-91aa-ec63f88cc541 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1314 microversion: 2.1 time: 0.166426 Mar 02 03:46:29.329211 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 475/922] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:29 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:29.398062 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f607f6cc-c85c-44d9-b298-d4d75b401237 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727478 Mar 02 03:46:29.399094 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 448/923] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:46:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:46:29.409224 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-52d36924-1e4d-4595-8591-88128c59a362 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:29.409840 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-52d36924-1e4d-4595-8591-88128c59a362 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:29.467607 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-52d36924-1e4d-4595-8591-88128c59a362 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:29.474239 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-52d36924-1e4d-4595-8591-88128c59a362 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1095 microversion: 2.1 time: 0.069207 Mar 02 03:46:29.474704 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 476/924] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:29 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:30.346296 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:30.347105 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:30.357200 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:30.357677 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:30.359806 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:30.360334 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:30.491043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:30.492550 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:30.499240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:30.500235 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:30.501216 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:30.501665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:30.508847 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:30.518167 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-340dcc3c-d406-4353-93ce-92405018577a tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1314 microversion: 2.1 time: 0.176483 Mar 02 03:46:30.527381 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 449/925] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:30 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:30.575866 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:30.583675 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f800977f-3f36-4d80-80da-b21d8bb7386d tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1211 microversion: 2.1 time: 0.096460 Mar 02 03:46:30.584258 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 477/926] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:30 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:30.984878 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-3c27c3fb-802e-4c97-be65-07d9583f3139 req-17c80a21-58d9-41f3-9ff4-46324bbc6644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8670385d-2f82-4976-a782-5a8c4d5527dd", "name": "network-vif-plugged", "status": "completed", "tag": "dc04b975-c768-4e00-bb9d-11a1f8c1fa5c"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:30.997111 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-3c27c3fb-802e-4c97-be65-07d9583f3139 req-17c80a21-58d9-41f3-9ff4-46324bbc6644 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:30.997902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-3c27c3fb-802e-4c97-be65-07d9583f3139 req-17c80a21-58d9-41f3-9ff4-46324bbc6644 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:31.013798 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-3c27c3fb-802e-4c97-be65-07d9583f3139 req-17c80a21-58d9-41f3-9ff4-46324bbc6644 service nova] Creating event network-vif-plugged:dc04b975-c768-4e00-bb9d-11a1f8c1fa5c for instance 8670385d-2f82-4976-a782-5a8c4d5527dd on hv-cinder-83109 Mar 02 03:46:31.021904 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-3c27c3fb-802e-4c97-be65-07d9583f3139 req-17c80a21-58d9-41f3-9ff4-46324bbc6644 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042514 Mar 02 03:46:31.023643 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 450/927] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:46:31.535104 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:31.535818 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:31.542037 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:31.542492 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:31.543305 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:31.543750 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:31.601835 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:31.602661 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:31.609345 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:31.609881 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:31.610754 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:31.611212 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:31.711107 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:31.719321 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-feed65a3-3546-4a7d-b322-622056bb7153 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1314 microversion: 2.1 time: 0.188087 Mar 02 03:46:31.720116 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 478/928] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:31 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:31.774629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:31.783713 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f5b536da-7cd0-41bf-a05d-0687e1c5988e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.186452 Mar 02 03:46:31.784627 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 451/929] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:31 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:32.197665 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-f97407a8-c3d0-4ab6-9844-06d1eedac50a req-2e108528-8b4d-417b-9376-a492244ef5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c16107-013d-455a-a85f-c6d899d8cef9", "tag": "8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:32.206623 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f97407a8-c3d0-4ab6-9844-06d1eedac50a req-2e108528-8b4d-417b-9376-a492244ef5ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:32.207827 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-f97407a8-c3d0-4ab6-9844-06d1eedac50a req-2e108528-8b4d-417b-9376-a492244ef5ee service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:32.221130 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-f97407a8-c3d0-4ab6-9844-06d1eedac50a req-2e108528-8b4d-417b-9376-a492244ef5ee service nova] Creating event network-changed:8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f for instance 54c16107-013d-455a-a85f-c6d899d8cef9 on hv-cinder-83109 Mar 02 03:46:32.226762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-f97407a8-c3d0-4ab6-9844-06d1eedac50a req-2e108528-8b4d-417b-9376-a492244ef5ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032595 Mar 02 03:46:32.227626 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 479/930] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:46:32.738492 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:32.739162 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:32.745457 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:32.745916 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:32.746753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:32.747162 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:32.802978 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:32.803852 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:32.810205 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:32.810971 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:32.812046 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:32.813188 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:32.932963 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:32.940345 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-247ecd0d-8d73-4725-a090-ba0486931237 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1498 microversion: 2.1 time: 0.205717 Mar 02 03:46:32.940915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 452/931] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:32 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1498 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:32.981076 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:32.988894 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-19d8ec56-9160-459d-bbda-16171a2617af tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.191180 Mar 02 03:46:32.989464 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 480/932] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:32 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:33.442979 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:33.443507 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:33.449632 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:33.450092 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:33.450877 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:33.451409 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:33.489017 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:46:33.560485 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-6108b866-4d99-4e01-8952-a18811a2c8bb tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 204 len: 0 microversion: 2.1 time: 0.121078 Mar 02 03:46:33.561066 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 453/933] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:46:33 2022] DELETE /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:46:33.569385 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:33.570002 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:33.576390 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:33.577470 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:33.578919 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:33.579457 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:33.713084 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:33.720678 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-e77757e7-6d37-4b61-aeed-3a25e89040f0 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1504 microversion: 2.1 time: 0.155135 Mar 02 03:46:33.721236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 481/934] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:33 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:34.006260 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:34.006953 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:34.013181 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:34.013627 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:34.014392 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:34.014825 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:34.147732 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:34.154918 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7865cc04-1718-4d40-aa42-6d8b81864f48 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.152934 Mar 02 03:46:34.155498 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 454/935] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:34 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:34.738680 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:34.739329 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:34.745596 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:34.746056 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:34.746842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:34.747323 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:34.884220 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:34.891423 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fb619b53-7e73-4783-9ab5-3aba14f558a7 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1504 microversion: 2.1 time: 0.157461 Mar 02 03:46:34.891989 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 482/936] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:34 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:35.172409 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:35.172932 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:35.179911 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:35.180366 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:35.181146 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:35.181584 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:35.316499 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:35.324191 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-b6f76eda-3039-438a-a33c-b50a2c8c74b5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.155679 Mar 02 03:46:35.324753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 455/937] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:35 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:35.636708 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-8dac7ebd-3c00-4091-8dc1-9ae47e542d98 req-1b5d3c44-d946-44f5-834b-0e3604a39ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8670385d-2f82-4976-a782-5a8c4d5527dd", "name": "network-vif-deleted", "tag": "dc04b975-c768-4e00-bb9d-11a1f8c1fa5c"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:35.645736 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-8dac7ebd-3c00-4091-8dc1-9ae47e542d98 req-1b5d3c44-d946-44f5-834b-0e3604a39ead service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:35.646184 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-8dac7ebd-3c00-4091-8dc1-9ae47e542d98 req-1b5d3c44-d946-44f5-834b-0e3604a39ead service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:35.657021 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-8dac7ebd-3c00-4091-8dc1-9ae47e542d98 req-1b5d3c44-d946-44f5-834b-0e3604a39ead service nova] Creating event network-vif-deleted:dc04b975-c768-4e00-bb9d-11a1f8c1fa5c for instance 8670385d-2f82-4976-a782-5a8c4d5527dd on hv-cinder-83109 Mar 02 03:46:35.661787 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-8dac7ebd-3c00-4091-8dc1-9ae47e542d98 req-1b5d3c44-d946-44f5-834b-0e3604a39ead service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028777 Mar 02 03:46:35.662378 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 483/938] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:46:35.908372 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:35.908980 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:35.914778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:35.915266 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:35.916034 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:35.916465 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:35.945714 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:35.946156 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:35.946594 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.objects.instance [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lazy-loading 'fault' on Instance uuid 8670385d-2f82-4976-a782-5a8c4d5527dd {{(pid=123425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:46:35.986897 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7da47f72554e6184532e3386eb1bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c3b4cd63d41a1876cfe423423469e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:35.993994 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-f9aaacab-ab86-4c6f-9a5c-e99d5147dca1 tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 200 len: 1304 microversion: 2.1 time: 0.089753 Mar 02 03:46:35.994539 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 456/939] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:35 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:36.396159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:36.396860 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:36.402812 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:36.403292 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:36.404061 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:36.404498 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:36.540490 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:36.547955 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-82b30963-6c04-4dc6-96fd-ec3fb20fb226 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.210296 Mar 02 03:46:36.548522 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 484/940] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:36 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:37.011617 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:37.012232 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] [instance: 8670385d-2f82-4976-a782-5a8c4d5527dd] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:37.019587 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:37.020039 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:37.020808 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:37.021244 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:37.034461 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] HTTP exception thrown: Instance 8670385d-2f82-4976-a782-5a8c4d5527dd could not be found. Mar 02 03:46:37.035035 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] Returning 404 to user: Instance 8670385d-2f82-4976-a782-5a8c4d5527dd could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:46:37.035897 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c32dba62-dfdf-4e00-a739-55847125400e tempest-VolumesActionsTest-1274449526 tempest-VolumesActionsTest-1274449526-project] 10.222.0.23 "GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd" status: 404 len: 111 microversion: 2.1 time: 0.028166 Mar 02 03:46:37.036403 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 457/941] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:37 2022] GET /compute/v2.1/servers/8670385d-2f82-4976-a782-5a8c4d5527dd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:46:37.566965 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:37.567883 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:37.574942 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:37.575434 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:37.576224 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:37.576666 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:37.716808 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:37.725355 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-46bd50aa-c218-4d27-a399-cbc1928a7f72 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.164554 Mar 02 03:46:37.725924 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 485/942] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:37 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:38.741858 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:38.742479 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:38.748693 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:38.749147 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:38.750051 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:38.750846 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:38.882159 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:38.889343 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-1b5a13bb-a4c7-4462-a353-ee6ef713e253 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.151338 Mar 02 03:46:38.889902 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 458/943] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:38 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:39.906494 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:39.907699 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:39.913558 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:39.914009 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:39.914784 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:39.915259 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:40.052876 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:40.060123 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c965c2d3-f7e7-48d3-b4d5-81403ecf1d90 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.157619 Mar 02 03:46:40.060679 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 486/944] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:39 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:41.076678 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:41.077215 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:41.083753 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:41.084242 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:41.085023 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:41.085680 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:41.219105 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:41.226699 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-3cbe6175-87ed-4d72-8ad9-ace14264156a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.154283 Mar 02 03:46:41.227284 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 459/945] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:41 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:42.244807 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:42.245420 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:42.252761 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:42.253279 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:42.254159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:42.254605 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:42.403873 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:42.412839 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9af89a0d-9128-4219-8355-49b1214c4d6f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.172026 Mar 02 03:46:42.413389 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 487/946] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:42 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:43.430990 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:43.431629 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:43.439813 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:43.440263 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:43.441055 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:43.441491 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:43.603010 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:43.612535 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-94d5bde0-ea54-40d9-a1c4-0d093bb23738 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.186622 Mar 02 03:46:43.613743 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 460/947] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:43 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:44.630198 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:44.631618 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:44.638286 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:44.638990 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:44.639997 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:44.640422 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:44.800063 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:44.808086 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-90a503d1-2aca-4b1e-9a14-a3123840e9d7 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.181777 Mar 02 03:46:44.818098 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 488/948] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:44 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:45.193005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-951eb6cc-c3af-4658-9a9e-d583013008da req-3b8ab2b0-5bd4-42ff-951a-9ea7859e407a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c16107-013d-455a-a85f-c6d899d8cef9", "name": "network-vif-plugged", "status": "completed", "tag": "8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:45.202346 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-951eb6cc-c3af-4658-9a9e-d583013008da req-3b8ab2b0-5bd4-42ff-951a-9ea7859e407a service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:45.202785 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-951eb6cc-c3af-4658-9a9e-d583013008da req-3b8ab2b0-5bd4-42ff-951a-9ea7859e407a service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:45.213711 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-951eb6cc-c3af-4658-9a9e-d583013008da req-3b8ab2b0-5bd4-42ff-951a-9ea7859e407a service nova] Creating event network-vif-plugged:8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f for instance 54c16107-013d-455a-a85f-c6d899d8cef9 on hv-cinder-83109 Mar 02 03:46:45.218709 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-951eb6cc-c3af-4658-9a9e-d583013008da req-3b8ab2b0-5bd4-42ff-951a-9ea7859e407a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127616 Mar 02 03:46:45.220362 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 461/949] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:46:45.825937 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:45.826653 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:45.834760 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:45.835252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:45.836049 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:45.836792 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:46.001007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:46.009869 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-800bd704-5ea4-4b84-9043-a0f6e1e8500f tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1267 microversion: 2.1 time: 0.187801 Mar 02 03:46:46.011139 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 489/950] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:45 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:47.030802 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:47.030802 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:47.037699 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:47.038163 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:47.038935 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:47.039410 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:47.183847 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:47.191924 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-52485f1b-fcc3-4dee-90a7-08c7a3154ee3 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1455 microversion: 2.1 time: 0.167997 Mar 02 03:46:47.192691 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 462/951] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:47 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:46:47.209488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:46:47.210708 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:46:47.217600 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:47.218315 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:47.220364 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:47.220978 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:47.372237 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:46:47.380650 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-d22fe6df-37a7-4ce8-887a-5755ae989152 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1455 microversion: 2.1 time: 0.174896 Mar 02 03:46:47.381537 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 490/952] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:46:47 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:46:49.707677 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-de55e93c-83b7-4214-8b29-4b503bb40133 req-c1dfcc35-f6c1-4809-a2e4-5c826265e66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c16107-013d-455a-a85f-c6d899d8cef9", "tag": "8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:46:49.725484 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-de55e93c-83b7-4214-8b29-4b503bb40133 req-c1dfcc35-f6c1-4809-a2e4-5c826265e66d service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:46:49.727207 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-de55e93c-83b7-4214-8b29-4b503bb40133 req-c1dfcc35-f6c1-4809-a2e4-5c826265e66d service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:46:49.739400 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-de55e93c-83b7-4214-8b29-4b503bb40133 req-c1dfcc35-f6c1-4809-a2e4-5c826265e66d service nova] Creating event network-changed:8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f for instance 54c16107-013d-455a-a85f-c6d899d8cef9 on hv-cinder-83109 Mar 02 03:46:49.745557 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-de55e93c-83b7-4214-8b29-4b503bb40133 req-c1dfcc35-f6c1-4809-a2e4-5c826265e66d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124517 Mar 02 03:46:49.746803 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 463/953] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:47:29.782427 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1130331340", "imageRef": "75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f", "flavorRef": "452"}} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:47:29.831834 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.network.neutron [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] validate_networks() for None {{(pid=123426) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 02 03:47:30.094539 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Flavor limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 02 03:47:30.094964 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Image limits 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 02 03:47:30.095479 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Flavor pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 02 03:47:30.095888 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Image pref 0:0:0 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 02 03:47:30.096298 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.virt.hardware [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 02 03:47:30.105905 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:30.106352 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:30.107190 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:30.107628 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:30.123701 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Getting quotas for project 791308934f7044b5989a0a484b021d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 02 03:47:30.127502 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.quota [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Getting quotas for user c8497adf5bc0457d95a2b464dd24a71e and project 791308934f7044b5989a0a484b021d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=123426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 02 03:47:30.138671 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Going to run 1 instances... {{(pid=123426) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 02 03:47:30.140954 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ee93a3-a4ba-4c1f-a93a-fcdc2cd4211f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 02 03:47:30.184306 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fa35f0db-b8a3-4028-80c4-338654297958 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.405709 Mar 02 03:47:30.184959 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 491/954] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Mar 2 03:47:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 02 03:47:30.196686 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-cd61f4f3-11bf-4ac2-b2cb-f867d4c387b7 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:30.197388 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-cd61f4f3-11bf-4ac2-b2cb-f867d4c387b7 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:30.255476 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-cd61f4f3-11bf-4ac2-b2cb-f867d4c387b7 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:30.262577 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-cd61f4f3-11bf-4ac2-b2cb-f867d4c387b7 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1215 microversion: 2.1 time: 0.071523 Mar 02 03:47:30.271396 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 464/955] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:30 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:31.279527 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:31.280140 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:31.286691 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:31.287167 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:31.287955 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:31.288391 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:31.355159 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:31.363347 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-9f0b678d-5f52-40fe-94d6-5058e8fb513d tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1275 microversion: 2.1 time: 0.087509 Mar 02 03:47:31.370341 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 492/956] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:31 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:32.381110 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:32.381676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:32.389289 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:32.389739 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:32.390549 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:32.390983 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:32.525149 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:32.532535 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-42c290ba-d0e0-4c98-95b7-92587225076f tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1315 microversion: 2.1 time: 0.155220 Mar 02 03:47:32.542323 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 465/957] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:32 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:32.895202 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-830fdef1-9fcd-42aa-af85-ef4d128e9de3 req-96c840f5-8ce2-4a19-8f25-693b0e0dc660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4268fc-83a1-4fda-8431-2f1ccd9cd20f", "tag": "b8c8c9a0-cd8b-42f4-8594-51819b944167"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:47:32.904376 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-830fdef1-9fcd-42aa-af85-ef4d128e9de3 req-96c840f5-8ce2-4a19-8f25-693b0e0dc660 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:32.904819 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-830fdef1-9fcd-42aa-af85-ef4d128e9de3 req-96c840f5-8ce2-4a19-8f25-693b0e0dc660 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:32.918769 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-830fdef1-9fcd-42aa-af85-ef4d128e9de3 req-96c840f5-8ce2-4a19-8f25-693b0e0dc660 service nova] Creating event network-changed:b8c8c9a0-cd8b-42f4-8594-51819b944167 for instance ee4268fc-83a1-4fda-8431-2f1ccd9cd20f on hv-cinder-83109 Mar 02 03:47:32.924252 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-830fdef1-9fcd-42aa-af85-ef4d128e9de3 req-96c840f5-8ce2-4a19-8f25-693b0e0dc660 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172828 Mar 02 03:47:32.925223 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 493/958] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:47:33.549763 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:33.550407 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:33.556915 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:33.557361 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:33.558145 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:33.558575 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:33.699694 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:33.706942 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-2990ec72-01f1-4538-9cf5-218208ed8be3 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1315 microversion: 2.1 time: 0.161078 Mar 02 03:47:33.707544 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 466/959] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:33 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:34.725081 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:34.725781 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:34.732895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:34.733341 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:34.734108 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:34.734543 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:34.865284 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:34.872527 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-475da674-a676-4998-a355-103cb35a0866 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1315 microversion: 2.1 time: 0.151638 Mar 02 03:47:34.873089 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 494/960] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:34 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:35.890117 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:35.890647 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:35.896856 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:35.897302 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:35.898069 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:35.898498 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:36.028716 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:36.035866 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-050f4ac9-6c50-48d9-b2f2-863cda1e1159 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1315 microversion: 2.1 time: 0.149657 Mar 02 03:47:36.036455 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 467/961] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:35 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:37.054036 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:37.054654 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:37.061009 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:37.061460 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:37.062246 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:37.062680 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:37.198067 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:37.205486 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-fee4989b-9d4b-46df-b2bd-d1388c5a4bdf tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1315 microversion: 2.1 time: 0.156151 Mar 02 03:47:37.206043 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 495/962] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:37 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:37.288612 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-d48bfa0e-f284-4ac8-aa4c-86326896b51e req-3c1334cb-7609-4781-9778-e47efafaa2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4268fc-83a1-4fda-8431-2f1ccd9cd20f", "name": "network-vif-plugged", "status": "completed", "tag": "b8c8c9a0-cd8b-42f4-8594-51819b944167"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:47:37.298066 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d48bfa0e-f284-4ac8-aa4c-86326896b51e req-3c1334cb-7609-4781-9778-e47efafaa2d1 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:37.298511 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d48bfa0e-f284-4ac8-aa4c-86326896b51e req-3c1334cb-7609-4781-9778-e47efafaa2d1 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:37.309297 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-d48bfa0e-f284-4ac8-aa4c-86326896b51e req-3c1334cb-7609-4781-9778-e47efafaa2d1 service nova] Creating event network-vif-plugged:b8c8c9a0-cd8b-42f4-8594-51819b944167 for instance ee4268fc-83a1-4fda-8431-2f1ccd9cd20f on hv-cinder-83109 Mar 02 03:47:37.314070 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-d48bfa0e-f284-4ac8-aa4c-86326896b51e req-3c1334cb-7609-4781-9778-e47efafaa2d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029216 Mar 02 03:47:37.314677 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 468/963] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:47:38.224248 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:38.224773 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:38.231644 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:38.232099 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:38.232882 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:38.233328 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:38.363842 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:38.371719 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-81e848b5-ca83-424d-85ee-f0ac0e0824dc tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1315 microversion: 2.1 time: 0.151445 Mar 02 03:47:38.372292 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 496/964] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:38 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:47:39.390153 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:39.390859 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:39.396979 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:39.397427 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:39.398202 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:39.398638 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:39.531287 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:39.538710 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-c2935f97-1fc6-4b2a-ab36-d4de196d7d3a tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1465 microversion: 2.1 time: 0.153853 Mar 02 03:47:39.539331 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 469/965] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:39 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:39.579872 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:39.580368 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:39.586059 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:39.586509 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:39.587307 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:39.587740 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:39.610340 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:47:39.689585 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-f6f64a97-2900-4009-9942-adfc81da0e18 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 204 len: 0 microversion: 2.1 time: 0.113208 Mar 02 03:47:39.690224 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 497/966] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:47:39 2022] DELETE /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:47:39.698733 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:39.699375 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:39.705094 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:39.705539 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:39.706297 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:39.706728 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:39.841206 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:39.848508 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-e1267721-40d9-48a0-878d-fc055e5cb773 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1471 microversion: 2.1 time: 0.154060 Mar 02 03:47:39.849057 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 470/967] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:39 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:40.866838 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:40.867564 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:40.874071 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:40.874518 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:40.875327 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:40.875762 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:41.012322 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:41.019680 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-efae1a81-479f-42bb-a7eb-9e134da1bef6 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1471 microversion: 2.1 time: 0.157117 Mar 02 03:47:41.020238 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 498/968] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:40 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:41.636904 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-d84f3e4a-956e-4b11-9eef-3d7f430f3c90 req-46f467d9-1ada-42f5-b12a-8624445087e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4268fc-83a1-4fda-8431-2f1ccd9cd20f", "name": "network-vif-deleted", "tag": "b8c8c9a0-cd8b-42f4-8594-51819b944167"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:47:41.646447 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d84f3e4a-956e-4b11-9eef-3d7f430f3c90 req-46f467d9-1ada-42f5-b12a-8624445087e2 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:41.647545 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d84f3e4a-956e-4b11-9eef-3d7f430f3c90 req-46f467d9-1ada-42f5-b12a-8624445087e2 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:41.659525 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-d84f3e4a-956e-4b11-9eef-3d7f430f3c90 req-46f467d9-1ada-42f5-b12a-8624445087e2 service nova] Creating event network-vif-deleted:b8c8c9a0-cd8b-42f4-8594-51819b944167 for instance ee4268fc-83a1-4fda-8431-2f1ccd9cd20f on hv-cinder-83109 Mar 02 03:47:41.664619 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-d84f3e4a-956e-4b11-9eef-3d7f430f3c90 req-46f467d9-1ada-42f5-b12a-8624445087e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032119 Mar 02 03:47:41.665443 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 471/969] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:47:42.036715 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:42.037340 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:42.044226 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:42.044694 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:42.045505 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:42.045948 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:42.079494 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:42.081021 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:42.081021 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.objects.instance [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lazy-loading 'fault' on Instance uuid ee4268fc-83a1-4fda-8431-2f1ccd9cd20f {{(pid=123426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 02 03:47:42.126245 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8497adf5bc0457d95a2b464dd24a71e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791308934f7044b5989a0a484b021d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:47:42.136333 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-c869b865-8250-48a9-a05d-46c79a49e677 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 200 len: 1305 microversion: 2.1 time: 0.103446 Mar 02 03:47:42.136920 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 499/970] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:42 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:47:43.154871 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:47:43.155540 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] [instance: ee4268fc-83a1-4fda-8431-2f1ccd9cd20f] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:47:43.161641 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:43.162086 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:43.162859 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:47:43.163326 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:47:43.176038 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] HTTP exception thrown: Instance ee4268fc-83a1-4fda-8431-2f1ccd9cd20f could not be found. Mar 02 03:47:43.176619 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] Returning 404 to user: Instance ee4268fc-83a1-4fda-8431-2f1ccd9cd20f could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:47:43.177434 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-053b7f8d-0d36-4c15-82d7-b69298175140 tempest-VolumesNegativeTest-199450228 tempest-VolumesNegativeTest-199450228-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f" status: 404 len: 111 microversion: 2.1 time: 0.027528 Mar 02 03:47:43.178026 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 472/971] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:47:43 2022] GET /compute/v2.1/servers/ee4268fc-83a1-4fda-8431-2f1ccd9cd20f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:47:48.894302 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:47:48.894736 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: Wed Mar 2 03:47:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:48:34.300089 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:34.300752 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:34.302417 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-ef650d04-fa34-4521-8dce-3bc7e8e3597f req-0e663ce9-bf6a-4aaf-b7a7-22cab3a45830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c16107-013d-455a-a85f-c6d899d8cef9", "tag": "8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:48:34.307342 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:34.307794 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:34.308576 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:34.309228 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:34.310288 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-ef650d04-fa34-4521-8dce-3bc7e8e3597f req-0e663ce9-bf6a-4aaf-b7a7-22cab3a45830 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:34.310734 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-ef650d04-fa34-4521-8dce-3bc7e8e3597f req-0e663ce9-bf6a-4aaf-b7a7-22cab3a45830 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:34.322259 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-ef650d04-fa34-4521-8dce-3bc7e8e3597f req-0e663ce9-bf6a-4aaf-b7a7-22cab3a45830 service nova] Creating event network-changed:8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f for instance 54c16107-013d-455a-a85f-c6d899d8cef9 on hv-cinder-83109 Mar 02 03:48:34.327642 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-ef650d04-fa34-4521-8dce-3bc7e8e3597f req-0e663ce9-bf6a-4aaf-b7a7-22cab3a45830 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029875 Mar 02 03:48:34.328515 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 473/972] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 02 03:48:34.334279 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Going to try to terminate instance {{(pid=123426) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:48:34.420393 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-4a33c072-18e0-4235-a293-968d0c374643 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "DELETE /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 204 len: 0 microversion: 2.1 time: 0.124105 Mar 02 03:48:34.421714 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 500/973] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:48:34 2022] DELETE /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:48:34.430155 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:34.430850 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:34.436869 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:34.437318 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:34.438088 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:34.438558 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:34.580184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:34.588147 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-a8ca729d-0ec4-4ac7-bb92-4944e0d2e0cb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1580 microversion: 2.1 time: 0.162259 Mar 02 03:48:34.591088 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 474/974] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:34 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:35.606236 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:35.606973 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:35.613351 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:35.613802 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:35.614579 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:35.615018 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:35.752007 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:35.759308 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-bccaed5f-a64b-420b-8992-0c858d857b46 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1461 microversion: 2.1 time: 0.157269 Mar 02 03:48:35.759866 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 501/975] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:35 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1461 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:36.777681 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:36.778296 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:36.785418 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:36.785877 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:36.786655 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:36.787125 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:36.918476 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:36.925958 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-17526ef3-dd2c-407b-917b-463bcf00357b tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1461 microversion: 2.1 time: 0.152142 Mar 02 03:48:36.926566 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 475/976] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:36 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1461 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:37.942255 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:37.942868 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:37.949447 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:37.949898 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:37.950672 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:37.951136 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:38.082638 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:38.089857 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-7963b8bb-42a3-4210-9606-1d0228beffed tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1461 microversion: 2.1 time: 0.151650 Mar 02 03:48:38.090407 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 502/977] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:37 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1461 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:39.107118 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:39.107651 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:39.113936 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:39.114384 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:39.115184 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:39.115620 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:39.248767 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:39.256653 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-40bc765c-4729-48af-888a-c79498c6d4fc tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1461 microversion: 2.1 time: 0.153467 Mar 02 03:48:39.257233 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 476/978] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:39 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1461 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:39.628628 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-46854228-c4b9-4624-8301-883c5bea1fba req-843ec7a3-8412-4145-9ec2-cdd70586411e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c16107-013d-455a-a85f-c6d899d8cef9", "name": "network-vif-unplugged", "status": "completed", "tag": "8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:48:39.639204 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-46854228-c4b9-4624-8301-883c5bea1fba req-843ec7a3-8412-4145-9ec2-cdd70586411e service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:39.639664 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-46854228-c4b9-4624-8301-883c5bea1fba req-843ec7a3-8412-4145-9ec2-cdd70586411e service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:39.651018 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-46854228-c4b9-4624-8301-883c5bea1fba req-843ec7a3-8412-4145-9ec2-cdd70586411e service nova] Creating event network-vif-unplugged:8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f for instance 54c16107-013d-455a-a85f-c6d899d8cef9 on hv-cinder-83109 Mar 02 03:48:39.656567 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-46854228-c4b9-4624-8301-883c5bea1fba req-843ec7a3-8412-4145-9ec2-cdd70586411e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032590 Mar 02 03:48:39.657367 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 503/979] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:48:40.273519 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:40.274129 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:40.280383 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:40.280833 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:40.281598 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:40.282676 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:40.414568 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:40.421822 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-d5a85b0f-b8a3-4f18-8b56-9a56f294ccdb tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1461 microversion: 2.1 time: 0.152223 Mar 02 03:48:40.422406 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 477/980] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:40 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1461 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:41.380327 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:48:41.380992 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: Wed Mar 2 03:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:48:41.440034 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:41.440744 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:41.447149 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:41.447611 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:41.448656 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:41.449098 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:41.588843 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:41.599214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-6cf65af2-deb9-4faf-a97c-0deb9bd25523 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 200 len: 1461 microversion: 2.1 time: 0.162383 Mar 02 03:48:41.599214 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 504/981] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:41 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 1461 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:41.656574 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [req-d78b4f53-18ba-4028-8c73-290507515424 req-a324d8e1-c60a-4742-b053-dedd5f4f7daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c16107-013d-455a-a85f-c6d899d8cef9", "name": "network-vif-deleted", "tag": "8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f"}]} {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:48:41.668315 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d78b4f53-18ba-4028-8c73-290507515424 req-a324d8e1-c60a-4742-b053-dedd5f4f7daa service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:41.668779 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [req-d78b4f53-18ba-4028-8c73-290507515424 req-a324d8e1-c60a-4742-b053-dedd5f4f7daa service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:41.680698 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.compute.server_external_events [req-d78b4f53-18ba-4028-8c73-290507515424 req-a324d8e1-c60a-4742-b053-dedd5f4f7daa service nova] Creating event network-vif-deleted:8a151d39-e79c-4eda-bbdf-cf03ea6ecb2f for instance 54c16107-013d-455a-a85f-c6d899d8cef9 on hv-cinder-83109 Mar 02 03:48:41.686153 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [req-d78b4f53-18ba-4028-8c73-290507515424 req-a324d8e1-c60a-4742-b053-dedd5f4f7daa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Mar 02 03:48:41.686770 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 478/982] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:48:42.614659 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:42.615241 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 54c16107-013d-455a-a85f-c6d899d8cef9] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:42.621805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:42.622256 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:42.623029 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:42.623488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:42.636586 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] HTTP exception thrown: Instance 54c16107-013d-455a-a85f-c6d899d8cef9 could not be found. Mar 02 03:48:42.637174 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Returning 404 to user: Instance 54c16107-013d-455a-a85f-c6d899d8cef9 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:48:42.637983 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-94eda308-6e23-47b2-a467-fe2ccf157335 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9" status: 404 len: 111 microversion: 2.1 time: 0.027346 Mar 02 03:48:42.638495 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 505/983] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:42 2022] GET /compute/v2.1/servers/54c16107-013d-455a-a85f-c6d899d8cef9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:48:45.689202 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:45.690572 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:45.691512 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-342ce31e-199b-4273-80a3-a96b9aed8ba5 req-e31b40d5-20f2-445e-acb2-4455b7d99351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff76d222-8051-4e45-ab07-cea636f36a52", "tag": "2099cb47-e552-4b42-abfc-256c9fad06ac"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:48:45.697623 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:45.698065 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:45.699338 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:45.699773 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:45.700476 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-342ce31e-199b-4273-80a3-a96b9aed8ba5 req-e31b40d5-20f2-445e-acb2-4455b7d99351 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:45.701170 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-342ce31e-199b-4273-80a3-a96b9aed8ba5 req-e31b40d5-20f2-445e-acb2-4455b7d99351 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:45.714180 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-342ce31e-199b-4273-80a3-a96b9aed8ba5 req-e31b40d5-20f2-445e-acb2-4455b7d99351 service nova] Creating event network-changed:2099cb47-e552-4b42-abfc-256c9fad06ac for instance ff76d222-8051-4e45-ab07-cea636f36a52 on hv-cinder-83109 Mar 02 03:48:45.719863 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-342ce31e-199b-4273-80a3-a96b9aed8ba5 req-e31b40d5-20f2-445e-acb2-4455b7d99351 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032570 Mar 02 03:48:45.720866 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 506/984] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:48:45.725329 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Going to try to terminate instance {{(pid=123425) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 02 03:48:45.811433 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-5d93d018-bd43-4c63-a8c9-e58d33529436 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 204 len: 0 microversion: 2.1 time: 0.126204 Mar 02 03:48:45.812172 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 479/985] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:48:45 2022] DELETE /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 02 03:48:45.822035 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:45.823621 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:45.833193 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:45.833643 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:45.834451 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:45.834892 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:45.976874 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.policy [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123426) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:45.985801 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-56f0866a-5930-447a-ab79-c71b59129d6e tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1577 microversion: 2.1 time: 0.168689 Mar 02 03:48:45.986861 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 507/986] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:45 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 02 03:48:47.003564 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:47.004270 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:47.010448 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:47.010907 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:47.011742 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:47.012183 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:47.149407 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:47.156835 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-85ffd929-9669-46a0-9baf-a83269e552db tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1459 microversion: 2.1 time: 0.157543 Mar 02 03:48:47.157400 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 480/987] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:46 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:47.967805 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [req-10b329ff-5b66-42b4-90bd-7d32472bf2a3 req-b13ba04f-da32-4b0f-8750-83fbe0a72ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff76d222-8051-4e45-ab07-cea636f36a52", "name": "network-vif-deleted", "tag": "2099cb47-e552-4b42-abfc-256c9fad06ac"}]} {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 02 03:48:47.976811 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-10b329ff-5b66-42b4-90bd-7d32472bf2a3 req-b13ba04f-da32-4b0f-8750-83fbe0a72ca7 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:47.977263 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [req-10b329ff-5b66-42b4-90bd-7d32472bf2a3 req-b13ba04f-da32-4b0f-8750-83fbe0a72ca7 service nova] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:47.988956 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.compute.server_external_events [req-10b329ff-5b66-42b4-90bd-7d32472bf2a3 req-b13ba04f-da32-4b0f-8750-83fbe0a72ca7 service nova] Creating event network-vif-deleted:2099cb47-e552-4b42-abfc-256c9fad06ac for instance ff76d222-8051-4e45-ab07-cea636f36a52 on hv-cinder-83109 Mar 02 03:48:47.993811 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [req-10b329ff-5b66-42b4-90bd-7d32472bf2a3 req-b13ba04f-da32-4b0f-8750-83fbe0a72ca7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029567 Mar 02 03:48:47.994414 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 508/988] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Mar 2 03:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 02 03:48:48.173854 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:48.174894 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:48.180316 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:48.180802 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:48.181608 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:48.182043 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:48.241855 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.policy [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bf8581a66d4e2aa6b86731b84b8d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f83d7fe62a4fca8328d978322a3cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123425) authorize /opt/stack/nova/nova/policy.py:199}} Mar 02 03:48:48.249147 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-4c57602b-a9ac-4dcf-b79e-aabccee15792 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 200 len: 1225 microversion: 2.1 time: 0.079274 Mar 02 03:48:48.249778 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 481/989] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:48 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 02 03:48:49.267951 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:49.268831 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: ff76d222-8051-4e45-ab07-cea636f36a52] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:49.274626 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:49.275109 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:49.275895 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:49.276339 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:49.289488 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] HTTP exception thrown: Instance ff76d222-8051-4e45-ab07-cea636f36a52 could not be found. Mar 02 03:48:49.290069 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Returning 404 to user: Instance ff76d222-8051-4e45-ab07-cea636f36a52 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:48:49.290882 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-59c73c1c-208d-4286-8221-cd3565fb3be1 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52" status: 404 len: 111 microversion: 2.1 time: 0.027848 Mar 02 03:48:49.291439 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 509/990] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:49 2022] GET /compute/v2.1/servers/ff76d222-8051-4e45-ab07-cea636f36a52 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 02 03:48:49.733097 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:49.733641 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.compute.api [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123425) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:49.740394 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:49.740849 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:49.741648 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:49.742068 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG oslo_concurrency.lockutils [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:49.755794 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.wsgi [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] HTTP exception thrown: Instance 7c58acd9-faf0-4300-9072-f415d3e63c41 could not be found. Mar 02 03:48:49.756373 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Returning 404 to user: Instance 7c58acd9-faf0-4300-9072-f415d3e63c41 could not be found. {{(pid=123425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:48:49.757209 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-398213fb-ecf2-418a-b05f-45e0dfe0141a tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 404 len: 111 microversion: 2.1 time: 0.028041 Mar 02 03:48:49.757717 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 482/991] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Mar 2 03:48:49 2022] DELETE /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:48:49.765752 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '>' {{(pid=123426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:49.766360 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.compute.api [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] [instance: 7c58acd9-faf0-4300-9072-f415d3e63c41] Fetching instance by UUID {{(pid=123426) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 02 03:48:49.772447 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:49.772896 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:49.773674 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 02 03:48:49.774111 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG oslo_concurrency.lockutils [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Lock "3ec61a67-357a-4a65-915a-6ee9dabb36ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 02 03:48:49.786905 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.wsgi [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] HTTP exception thrown: Instance 7c58acd9-faf0-4300-9072-f415d3e63c41 could not be found. Mar 02 03:48:49.787513 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: DEBUG nova.api.openstack.wsgi [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Returning 404 to user: Instance 7c58acd9-faf0-4300-9072-f415d3e63c41 could not be found. {{(pid=123426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 02 03:48:49.788325 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO nova.api.openstack.requestlog [None req-56eb228c-91de-43b6-ac98-51849857e9a8 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41" status: 404 len: 111 microversion: 2.1 time: 0.026547 Mar 02 03:48:49.788854 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: [pid: 123426|app: 0|req: 510/992] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Mar 2 03:48:49 2022] GET /compute/v2.1/servers/7c58acd9-faf0-4300-9072-f415d3e63c41 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 02 03:48:51.074005 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: DEBUG nova.api.openstack.wsgi [None req-7aa5f044-dd65-4c06-bf6c-234d87b734e5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] Calling method '.version_select at 0x7fc38c4c6160>' {{(pid=123425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 02 03:48:51.099248 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO nova.api.openstack.requestlog [None req-7aa5f044-dd65-4c06-bf6c-234d87b734e5 tempest-TestVolumeBootPattern-1359334138 tempest-TestVolumeBootPattern-1359334138-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2127554969" status: 202 len: 0 microversion: 2.1 time: 0.029363 Mar 02 03:48:51.099825 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: [pid: 123425|app: 0|req: 483/993] 10.222.0.23 () {58 vars in 1262 bytes} [Wed Mar 2 03:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2127554969 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 02 03:49:24.137597 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:49:24.138201 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: Wed Mar 2 03:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:50:45.703595 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:50:45.704207 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: Wed Mar 2 03:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:51:08.902637 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:51:08.903376 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: Wed Mar 2 03:51:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:51:24.951565 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:51:24.952055 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: Wed Mar 2 03:51:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:51:37.753937 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:51:37.754506 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: Wed Mar 2 03:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:52:01.388890 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:52:01.389596 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: Wed Mar 2 03:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:52:44.145701 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:52:44.146428 dv-cinder-831090-3-iscsi devstack@n-api.service[123425]: Wed Mar 2 03:52:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 02 03:54:05.711614 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 02 03:54:05.712240 dv-cinder-831090-3-iscsi devstack@n-api.service[123426]: Wed Mar 2 03:54:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!